-- Logs begin at Thu 2021-11-25 04:09:29 UTC, end at Thu 2021-11-25 05:06:58 UTC. -- Nov 25 04:34:59.999946 dv-cinder-815582-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 25 04:35:00.009250 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 25 04:35:00 2021] *** Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: nodename: dv-cinder-815582-6-iscsi Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: machine: x86_64 Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: clock source: unix Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: pcre jit disabled Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: detected number of CPU cores: 4 Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: current working directory: / Nov 25 04:35:00.011538 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: detected binary path: /usr/bin/uwsgi-core Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: your processes number limit is 47680 Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: your memory page size is 4096 bytes Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: detected max file descriptor number: 2048 Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: lock engine: pthread robust mutexes Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: thunder lock: enabled Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 25 04:35:00.012096 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 25 04:35:00.056723 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: Python main interpreter initialized at 0x5567facd49c0 Nov 25 04:35:00.056723 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: python threads support enabled Nov 25 04:35:00.056723 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: your server socket listen backlog is limited to 100 connections Nov 25 04:35:00.056723 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: your mercy for graceful operations on workers is 90 seconds Nov 25 04:35:00.057078 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: mapped 403077 bytes (393 KB) for 2 cores Nov 25 04:35:00.057162 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: *** Operational MODE: preforking *** Nov 25 04:35:00.057418 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: *** uWSGI is running in multiple interpreter mode *** Nov 25 04:35:00.057418 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: spawned uWSGI master process (pid: 85540) Nov 25 04:35:00.057588 dv-cinder-815582-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 25 04:35:00.058968 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: spawned uWSGI worker 1 (pid: 85551, cores: 1) Nov 25 04:35:00.058968 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: spawned uWSGI worker 2 (pid: 85552, cores: 1) Nov 25 04:35:00.058968 dv-cinder-815582-6-iscsi devstack@keystone.service[85540]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 25 04:35:05.346015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 04:35:05.346015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: from cryptography.utils import int_from_bytes Nov 25 04:35:05.346855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 04:35:05.346855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: from cryptography.utils import int_from_bytes Nov 25 04:35:05.348979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 04:35:05.348979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: from cryptography.utils import int_from_bytes Nov 25 04:35:05.349483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 04:35:05.349483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: from cryptography.utils import int_from_bytes Nov 25 04:35:05.395502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 04:35:05.395694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 04:35:05.395832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] command line args: [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 04:35:05.396130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 04:35:05.396295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ================================================================================ {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 04:35:05.396572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] admin_token = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.396818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] config_dir = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.396993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.397088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 04:35:05.397161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] config_source = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.397228 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 04:35:05.397362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] debug = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.397447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] command line args: [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 04:35:05.397520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.398945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 04:35:05.398945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ================================================================================ {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 04:35:05.399070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] admin_token = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] config_dir = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] config_source = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] debug = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_config_append = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.399998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_dir = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_file = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_config_append = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_dir = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.400950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_file = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.401895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.402998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] publish_errors = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.403916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] publish_errors = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.404919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] standard_threads = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] use_journal = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] use_json = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.405986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] standard_threads = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] use_stderr = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] use_syslog = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.406758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] use_journal = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.406911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] use_json = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.407053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] use_stderr = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.407207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] use_syslog = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.407360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 04:35:05.407637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.407914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.408995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.409966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.410997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.411947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412060 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.412907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.413822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.414924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.415951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.416905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.417907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.418907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.419956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.420917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.421971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.422969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.423898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.424954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.425968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.426921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.427988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.428982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.external = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.external = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.429907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.password = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] auth.token = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.password = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] auth.token = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.430972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.431899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.432999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.433925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.434974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.435925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.436903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.437940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.438992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.439999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.440939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.441953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.442988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.443940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.444885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.445917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.446971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.447975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448606 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.448946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.449978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.450901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.451972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.452927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.453966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.454992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.455913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.456894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.457925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.458966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.459996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.460939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.461945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] role.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] role.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] role.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] role.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.462974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.463916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.464910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.465949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.466873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.467906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.468967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.469919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.470959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.471885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.472954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.473984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.connection = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.474899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.connection = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.475942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.476994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.477841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.478975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.479088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 04:35:05.479208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.479208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 04:35:05.479208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 04:35:05.507449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.507595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.507711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.507793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.507898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.508068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.518250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.518397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.546549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.546705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.546873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.546958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.598822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.599294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.649311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.649523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.650432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.650671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.714817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.715707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.738402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.738622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.738720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.738832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.738925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.739942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.751067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.751583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.763833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.764948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.765105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.765232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.765314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.765520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 25 04:35:05.783903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.784085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 25 04:35:05.784475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.784601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.784737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 25 04:35:05.784818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 25 04:35:05.784882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 25 04:35:05.785469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.785823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.786088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.786344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.796138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.796442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.796707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.796980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.797106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.797243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.797550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.797832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.805035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.805940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.808203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.808532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.808896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.809235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.809399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.809509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.809615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.809757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.809892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.810080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.810272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.810572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.810817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.811107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.811233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.811417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.811676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.811945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.812220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.812531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.812804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.813071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.836858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.838427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.838711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.838969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.840685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.840966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.843980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.844402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.844681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.846128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.846410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.846811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.851780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.852018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.853933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.854213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.856463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.856751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.857034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.857309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.857582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.857853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.858119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.858382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.858654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.858925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.859210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.859490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.859745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.860018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.860313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.860586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.877057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.877341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.879438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.879714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.881776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.884243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.885330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.885727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.887870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.888188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.890672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.893226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.894189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.896770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.897739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.898032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.898316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.898601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.898876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.899145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.900365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.900661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.900944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.901227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.901504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.901764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.917775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.918059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.918317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.918570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.920968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.921253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.921520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.921783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.926226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.927889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.928173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.929516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.931200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.931326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.931466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.931546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.931773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.932060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.932365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.934619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.934918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.935220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.935456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.935774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.945312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.945585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.945863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.946136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.946509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.946782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.947057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.948789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.949132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.949442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.949709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.949991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.950364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.950641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.964448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.967712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.968246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.970940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.971426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.972661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.974259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.974534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.974702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.974799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.976460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.978076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.978357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.978647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.982037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.983596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.985789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.986744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.987031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.987369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.987496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.987646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.990566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.990850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.991244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.991524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.996656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:05.996938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:05.997211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.000831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:06.001118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.001399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.005161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=85552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:06.005410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.005709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.005975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.006252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.006623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.006897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.007167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.007432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.007712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.007968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.008249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.008518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.008774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.009080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=85551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 25 04:35:06.009361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.009649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.009925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.010196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.010579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.010862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.011132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.011411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.011747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.012018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.012316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.012597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.012861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 25 04:35:06.046847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567facd49c0 pid: 85552 (default app) Nov 25 04:35:06.050399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bdd55-ebf0-41b3-a3ee-182d2848c6e0 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:06.050689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bdd55-ebf0-41b3-a3ee-182d2848c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:06.050961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bdd55-ebf0-41b3-a3ee-182d2848c6e0 None None] PATH_INFO: `/v3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:06.051220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567facd49c0 pid: 85551 (default app) Nov 25 04:35:06.055124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Nov 25 04:35:06 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:14.102508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:14.103414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:14.103414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:14.109654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:14 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:14.118387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:14.118817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:14.118918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:14.151564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG oslo_db.sqlalchemy.engines [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 04:35:14.361007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG passlib.handlers.bcrypt [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=85552) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 25 04:35:14.361405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG passlib.handlers.bcrypt [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85552) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 25 04:35:14.418224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:14.419850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:14.560036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:14.773949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:14.820438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG oslo_db.sqlalchemy.engines [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 04:35:14.953678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94560bf0-0488-4cea-8155-606ee0c6061d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:14.959199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:14.959861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:14.960132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:14.960440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:14.969249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:15.020423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 25 04:35:15.020756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ab43-b9a5-42ee-a829-6c4b4a07da8f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:15.031055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:15.042307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:15.070373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2ec8d-11b7-44ca-82c0-dd6f8f33d81a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:15.076183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:15.077485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:15.077788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:15.078065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] PATH_INFO: `/v3/projects/eecafb0e45fb4de69b43e46178412ed9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:15.079742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] RBAC: Authorizing `identity:get_project(project_id=eecafb0e45fb4de69b43e46178412ed9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:15.130239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 25 04:35:15.130830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad9b1-557c-4841-a575-ffcebb20cadd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:15.135183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:15 2021] GET /identity/v3/projects/eecafb0e45fb4de69b43e46178412ed9 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:17.448342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f90f-5c6e-4b27-ab9d-115ccbefda18 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:17.448909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f90f-5c6e-4b27-ab9d-115ccbefda18 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:17.448909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f90f-5c6e-4b27-ab9d-115ccbefda18 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:17.453607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:17.461123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:17.461896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:17.462025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:17.485818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:17.487359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:17.499206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:17.527891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f90f-5c6e-4b27-ab9d-115ccbefda18 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:17.543983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f90f-5c6e-4b27-ab9d-115ccbefda18 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:17.549789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:17.550459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:17.550747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:17.551019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:17.560067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:17.561923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d441955-c96d-44de-91eb-16435e328054 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:17.571345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:17.579711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:17.589093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cf7fa-67a4-4314-b22d-eb275aaf8994 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:17.594843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:17.595733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:17.596019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:17.596334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:17.597926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:17.599783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09acda7-68d8-45ca-ba11-1c00b82cef70 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:17.601390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:17 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:20.034187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11433-d8e0-4583-ab4c-f0c815fe7e99 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.034692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11433-d8e0-4583-ab4c-f0c815fe7e99 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.034692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11433-d8e0-4583-ab4c-f0c815fe7e99 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.034827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b52e7-697d-43c1-8c4f-2f66da089487 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.035193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b52e7-697d-43c1-8c4f-2f66da089487 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.035370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b52e7-697d-43c1-8c4f-2f66da089487 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.037121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:20.038362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:20.045298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.045587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.045698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.045868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.045964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.046221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.089480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG passlib.handlers.bcrypt [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=85551) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 25 04:35:20.089949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG passlib.handlers.bcrypt [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85551) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 25 04:35:20.136685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:20.138430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:20.163086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:20.174320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:20.175525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:20.183729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:20.186295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.197225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535e1d7-4d96-4eba-8f26-adc54a33169d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.206123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.207644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.208079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.208538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.216833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.220163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.222000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.225745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cfbc4-b700-4431-9ddb-f58f2df8e49a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.230178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.230768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:20.231082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.231369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.231642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.236919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.244906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:20.245550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97efd4-3f55-4789-8620-5ba3c2df0dd8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.251312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.252085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.252230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:20.252376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.252670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.253413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:35:20.254033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.255753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.257497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 8/16] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:20.259556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.270541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21010a-94a0-4f16-9fda-5c6c54cae809 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.275474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.276189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.276489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.276766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.277649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:20.277964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.280008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:20.280008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:20.280008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:20.280990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.296573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:20.302781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.313742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb14d7-98ea-4da0-9e9a-002e8536781a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.319404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.320370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.320666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.320942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.322650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.324637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.326397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:20.333071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.344849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc0ce-af2d-4702-ad5f-e04d71d2c411 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.350140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.350982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.351269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.351546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.352893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.354660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444662b-d8f5-4ecf-9f82-21dd9b9a38f6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.356377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:20.363179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:20.377781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ae9e-b4d1-4532-b791-66cd7b050634 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:20.385445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:20.386126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:20.386411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:20.386709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:20.387858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.domain.id=default, user.id=413d9d96bebe4a659dd26ecc16805343) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:20.388189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:20.390081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:20.390081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:20.390081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:20.391262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2951-6f03-472c-909c-00a8c73ed36e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:20.402245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1343 bytes} [Thu Nov 25 04:35:20 2021] GET /identity/v3/role_assignments?user.id=413d9d96bebe4a659dd26ecc16805343&scope.domain.id=default&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 233 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:23.228762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6cb-406e-45a1-8026-a7211f3b0a05 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.229296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6cb-406e-45a1-8026-a7211f3b0a05 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.229296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6cb-406e-45a1-8026-a7211f3b0a05 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.231541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:23.237221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d643e3-a6c7-479f-b5db-cb7e31ebefc8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.237634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d643e3-a6c7-479f-b5db-cb7e31ebefc8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.237837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d643e3-a6c7-479f-b5db-cb7e31ebefc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.252635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867da8b-e6c6-4e4d-bffb-ef686a2b4c5c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.252910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867da8b-e6c6-4e4d-bffb-ef686a2b4c5c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.253190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867da8b-e6c6-4e4d-bffb-ef686a2b4c5c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.255129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:23.260487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb29e-6acc-47fe-ae8e-e2a934536cbb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.260775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb29e-6acc-47fe-ae8e-e2a934536cbb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.261050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb29e-6acc-47fe-ae8e-e2a934536cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.283666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b7d643e3-a6c7-479f-b5db-cb7e31ebefc8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:23.284941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7d643e3-a6c7-479f-b5db-cb7e31ebefc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:23.291830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a96eb29e-6acc-47fe-ae8e-e2a934536cbb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:23.293070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a96eb29e-6acc-47fe-ae8e-e2a934536cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:23.301158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:23.302710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:23.303051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce019b-bead-4a42-a04c-d770f45153db None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.303549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce019b-bead-4a42-a04c-d770f45153db None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.304027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce019b-bead-4a42-a04c-d770f45153db None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.306221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 14/25] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:23.321528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.321820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.322282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.350858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:23.351217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce019b-bead-4a42-a04c-d770f45153db None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.352112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:23.364032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 12/26] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:23.365096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.371654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce019b-bead-4a42-a04c-d770f45153db None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.377860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aa932-f367-4f9f-9ea0-83de9c872f06 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.381639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.382325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.382611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.382884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.383686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.384891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:23.384891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:23.384891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:23.385915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.393863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.394774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.395118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.395398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.428450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:23.435724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:23.437556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 13/27] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:23.438461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.454189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a407-a1c8-4654-9b93-85e716565e62 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.472573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.473746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.474236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.474703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.519703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.521609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.544086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:35:23.546086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:23.547074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.554296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 15/29] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:35:23 2021] POST /identity/v3/roles => generated 219 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:35:23.565200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.578582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e655e9e-31ab-4261-8650-87e0d9714755 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.584179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5753c2-8290-4329-88ba-b5a5969c6f9a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.588109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.588847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.589132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.589404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.590298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:23.590606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.591648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:23.591648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:23.591648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:23.592609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.597443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.598133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.598421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.598696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.599454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:23.599760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.601035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:23.601035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:23.601035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:23.601959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.632532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 15/30] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:23.637298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 16/31] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:23.638384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.640423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.650888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b1d36-080b-4880-b916-a72c9bcde6a5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.654403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326530e-b735-42f4-bc49-968f5b2f6b44 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.667703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.668516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.669432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.669721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.670010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.670811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.671883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:23.671883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:23.671883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:23.673219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4e5b4-99c2-45d4-a8c7-7ef9bda5cfd0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.676004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.680556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.680913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.682480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.684430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.686132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 16/32] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:23.692093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.711720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d57b-0451-4626-8764-c746148c57ed admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.729280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.730281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.730612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.730956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.734697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.738097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:23.742718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 17/33] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:23.749572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 17/34] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:35:23 2021] POST /identity/v3/projects => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:23.750919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:23.766094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70dc10-f4dc-43cc-8723-9157db30908d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:23.857076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:23.857997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:23.858286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:23.858572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] PATH_INFO: `/v3/domains/default/users/413d9d96bebe4a659dd26ecc16805343/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:23.860788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=413d9d96bebe4a659dd26ecc16805343, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:23.861854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:23.861854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:23.861854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:23.863899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:24.081575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de72-1383-4765-9a86-c4161bb124cd None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.081981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de72-1383-4765-9a86-c4161bb124cd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.082146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de72-1383-4765-9a86-c4161bb124cd None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.088541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 18/35] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:24 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:24.090768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157658a2-0342-4b6d-93f6-ba6222c3ff29 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.091061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157658a2-0342-4b6d-93f6-ba6222c3ff29 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.091345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157658a2-0342-4b6d-93f6-ba6222c3ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.116125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1382 bytes} [Thu Nov 25 04:35:23 2021] PUT /identity/v3/domains/default/users/413d9d96bebe4a659dd26ecc16805343/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:24.123697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-157658a2-0342-4b6d-93f6-ba6222c3ff29 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:24.125727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-157658a2-0342-4b6d-93f6-ba6222c3ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:24.205810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:24.234707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:24.247858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bfdb-ce13-4046-9246-6c89d327a499 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:24.256624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:24.257330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.257618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.257897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.258717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:24.260030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:24.260030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:24.260030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:24.260985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c6d8-7fbd-42ce-a4c3-f554267e3948 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:24.283740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 19/38] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:35:24 2021] POST /identity/v3/roles => generated 225 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:24.440371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f9e7-8ef0-485e-9e59-1225738d1408 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.440984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f9e7-8ef0-485e-9e59-1225738d1408 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.440984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087f9e7-8ef0-485e-9e59-1225738d1408 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.442942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 20/39] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:24.449341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a86b-acde-4ace-b9a2-60aaadd29284 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.449625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a86b-acde-4ace-b9a2-60aaadd29284 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.449910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194a86b-acde-4ace-b9a2-60aaadd29284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.469630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3194a86b-acde-4ace-b9a2-60aaadd29284 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:24.471249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3194a86b-acde-4ace-b9a2-60aaadd29284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:24.479714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 20/40] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:24.504803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f9e7-8ef0-485e-9e59-1225738d1408 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:24.522534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087f9e7-8ef0-485e-9e59-1225738d1408 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:24.530895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:24.531663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.531949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.532258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.533181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:24.535584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60f23b-f60b-4dce-8309-04e54154513b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:24.557416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:35:24 2021] POST /identity/v3/roles => generated 223 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:24.948199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b7c9-909e-4206-a3fb-4c08b44ef5a0 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.948521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b7c9-909e-4206-a3fb-4c08b44ef5a0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.948803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b7c9-909e-4206-a3fb-4c08b44ef5a0 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.950685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 21/42] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:24.956708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:24.957003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:24.957282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:24.976308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:24.977523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:24.986369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 22/43] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:25.011877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b7c9-909e-4206-a3fb-4c08b44ef5a0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:25.026504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b7c9-909e-4206-a3fb-4c08b44ef5a0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:25.032183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:25.033015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:25.033310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:25.033592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:25.034873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:25.036662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57103e05-1963-48a5-9107-c7dab7d09d21 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:25.038271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 22/44] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:25.044472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:25.054136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609edb14-c655-40b9-9505-5bb23c8bf4da None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:25.060518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:25.061175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:25.061469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:25.061751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:25.062488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:25.064539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9f0ca-5372-419e-a7eb-7257172b5da4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:25.090940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:35:25 2021] POST /identity/v3/projects => generated 312 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:26.573561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb69dd-c0d8-4ebc-adec-51b8ad99214c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.573980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb69dd-c0d8-4ebc-adec-51b8ad99214c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.574236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb69dd-c0d8-4ebc-adec-51b8ad99214c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.576376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 23/46] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:26.582631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.583079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.583168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.602577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:26.603848 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:26.662411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:26.686492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb69dd-c0d8-4ebc-adec-51b8ad99214c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:26.700708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb69dd-c0d8-4ebc-adec-51b8ad99214c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:26.705723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:26.706512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.706797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.707080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.717930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:26.724714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:26.725865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:26.732203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:26.741311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6285-1fa3-4f8e-a97a-d0d2d9ce969f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:26.746063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:26.746736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.747027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.747308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.748087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:26.748431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:26.750410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:26.758662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 25/49] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:26.764533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:26.775331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837586-e687-424c-bf37-e6d7d1bd9d52 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:26.780637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:26.781509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.781796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.782071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.783438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:26.785330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:26.786916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 25/50] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:26 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:26.792904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:26.803026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dfb77-45a6-4d71-94e8-968f772fa078 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:26.808042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:26.808897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.809190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.809474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.810698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:26.812428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bff93-4f4f-4921-b154-b10f87f529c0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:26.813999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 26/51] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:26.820340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:26.831660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcbe0-7cd4-4dae-a8f0-5046b044d39f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:26.837524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:26.838162 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:26.838448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:26.838838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:26.839794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.domain.id=default, user.id=413d9d96bebe4a659dd26ecc16805343) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:26.840103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:26.842182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63e627-9b53-4b19-bd16-9c7609e7f762 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:26.848715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 26/52] 10.222.0.36 () {56 vars in 1343 bytes} [Thu Nov 25 04:35:26 2021] GET /identity/v3/role_assignments?user.id=413d9d96bebe4a659dd26ecc16805343&scope.domain.id=default&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 530 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:27.452309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f776aa-c472-4ae6-a5af-a180853ee099 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:27.452754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f776aa-c472-4ae6-a5af-a180853ee099 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:27.453148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f776aa-c472-4ae6-a5af-a180853ee099 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:27.455986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 27/53] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:27.461923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:27.462212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:27.462494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:27.482035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:27.483221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:27.491224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:27.515737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f776aa-c472-4ae6-a5af-a180853ee099 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:27.538666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f776aa-c472-4ae6-a5af-a180853ee099 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:27.546222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:27.547022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:27.547312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:27.547589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:27.548928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:27.550643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb403c0-43b8-4a81-9a23-dc380ef54460 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:27.552284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:27.558034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:27.567175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fb5e7-f5cc-4e2d-9123-0a642559081f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:27.573126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:27.573791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:27.574551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:27.574669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:27.575910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:27.577795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:27.577795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:27.577795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:27.579827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5588947-58a4-4b68-8166-57edcca9e752 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:27.620087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1161 bytes} [Thu Nov 25 04:35:27 2021] POST /identity/v3/projects => generated 298 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:29.973573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f284-e587-4f6b-be34-eceb4f4920cb None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:29.974376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f284-e587-4f6b-be34-eceb4f4920cb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:29.974376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1f284-e587-4f6b-be34-eceb4f4920cb None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:29.979016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 29/57] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:29.988591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:29.989025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:29.989224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:30.012843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:30.014076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:30.073405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 29/58] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:30.105314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f284-e587-4f6b-be34-eceb4f4920cb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:30.120809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1f284-e587-4f6b-be34-eceb4f4920cb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:30.127565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:30.128404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:30.128695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:30.128969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:30.130323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:30.132037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b60271-da0c-4bc9-821a-6c414a90b0cf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:30.133664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:30.140317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:30.155201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf6eea-9638-4bdf-ab0b-f1c3740e1196 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:30.161335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:30.161998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:30.162282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:30.162550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:30.163276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:30.164331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:30.164331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:35:30.164331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:35:30.165556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d363-7df6-402c-84fc-a4174be3824a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:30.193392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 30/60] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:30 2021] POST /identity/v3/users => generated 275 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:33.762860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee0c7-400e-489c-b1fb-cb10ed654836 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.763951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee0c7-400e-489c-b1fb-cb10ed654836 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.764473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee0c7-400e-489c-b1fb-cb10ed654836 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.766938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 31/61] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:33.773339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.774299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.774784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.805229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:33.806815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:33.815449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 31/62] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:33.856644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c883c6-b3aa-45d8-9df1-33e779f21db4 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.856644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c883c6-b3aa-45d8-9df1-33e779f21db4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.856644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c883c6-b3aa-45d8-9df1-33e779f21db4 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.857350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:33.857548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:33.863515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.864065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.864587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.867114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ee5b-c93b-4208-906c-9ce8814d3028 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:33.882286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:33.883484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.883968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.884474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.896041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:33.897715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:33.902714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:33.911715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:33.917073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 32/64] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:35:33.919418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 33/65] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:33.925154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:33.943662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:33.949423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be8c20-92e7-4602-b03d-d3bad0db9b10 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:33.954227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e4832-5a4f-4ab8-9862-b7e2ea6240f6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:33.961413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:33.962200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:33.963233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.964212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:33.964720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.965239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:33.965910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.966377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:33.967891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:33.969824 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:33.971670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:33.984468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 33/66] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:33.991186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:33.993210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:34.007173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:34.010294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:35:34.015421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.020785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337e7f1-0576-4c42-b5c0-5e6d4b29e9b3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.035196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e128f8-902e-4638-8614-c6c17652419a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.036122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.037225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.037664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.038086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.056425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.058598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.060418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 34/68] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:33 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.066246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.066952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.067235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.067510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.068324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.068633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.070297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.072711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.087474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.089399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b90eb2-fe50-4bd1-beea-e29b7d6261a2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.093481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.103816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64662286-2910-4aad-bbdd-a9f47afbb3d7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.105424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.106462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.106865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.107141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.110307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.111403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.111844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.112307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.113682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.115682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.117786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.122752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.122752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.124046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.134577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74b6c0-9737-45f3-bb16-c7883324e0b3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.139850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.140770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.141242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.141705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.144644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 35/71] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:34.151226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.151369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.153625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af194ff-776d-4150-a717-abbcc9dc40c4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.160600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27e07-5ba9-4507-9df9-36696a400424 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.163678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:34.165302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.165588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b53d-f716-4b65-8b6c-e48728dda324 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.165992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b53d-f716-4b65-8b6c-e48728dda324 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.166372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778b53d-f716-4b65-8b6c-e48728dda324 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.166805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.167237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.167651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.168978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 38/73] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:34.169315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.171434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.173167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 36/74] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.177941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4357a-321b-4025-b985-a7690250a7cb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.178918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.179479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4357a-321b-4025-b985-a7690250a7cb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.179981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4357a-321b-4025-b985-a7690250a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.189041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63e3a8-d54c-45c9-af2b-1f798c9acf5b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.193299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.194158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.194443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.194718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.195903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.198002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2fb4357a-321b-4025-b985-a7690250a7cb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:34.198102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.199202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2fb4357a-321b-4025-b985-a7690250a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:34.199965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.200562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.210885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:34.212352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73ac-363a-4453-b778-4133f3b0ebbd None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.212704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73ac-363a-4453-b778-4133f3b0ebbd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.213041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc73ac-363a-4453-b778-4133f3b0ebbd None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.215077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528b8e3-9546-4c9a-b4e2-3bd6443ca96d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.215201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 40/77] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:34.215923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc73ac-363a-4453-b778-4133f3b0ebbd None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.224654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.225512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.225952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.226375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.227358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.227811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.229895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d561700-98af-4f9e-9cf2-017974ae7872 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.230814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc73ac-363a-4453-b778-4133f3b0ebbd None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.235259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.235979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.236361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.236710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.236970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 38/78] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=7a34713434094c19b43446fca1e27cf7 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.238423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.238898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.239185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.240689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=413d9d96bebe4a659dd26ecc16805343) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.241090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.242235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:34.242235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:34.242235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:34.243510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.253416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 41/79] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/role_assignments?user.id=413d9d96bebe4a659dd26ecc16805343&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.261375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.273726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:34.275500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:34.283355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94247d81-1c59-40e5-b98e-20b94ab19ffb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.292667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:34.301078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.302374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.302962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.303450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.319619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:34.331887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:34.333649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 42/81] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:34.340130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.354001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79d7e2-fc95-42c0-a95b-9c71445054e4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.361267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.372225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.373366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.373853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.374328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.375742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.376716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.379412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627db1-b864-4c60-94ca-ab85f92d0347 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.381550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.393882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.395122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.395599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.396063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.400750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 40/82] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.407384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.417920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0e90-e00e-4662-99cd-20475fe9ab74 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.424222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.424222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.424222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.424541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.425802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.426710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:34.428069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.429891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 41/83] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.436614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.439431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:34.441327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 43/84] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:35:34.447160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55e22f-3723-4f83-8d2d-6ec7d7a7f859 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.448278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.452319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.453008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.453300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.453582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.462726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.464595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc715d-c7d1-4709-9f6b-540e7803194d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.465165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c96982-51ff-4661-b8b0-a3c658fa6e6a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.472738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.473467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.473754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.474031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.474823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.475132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.475897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 42/85] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:35:34.476929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda669e-8bd8-4001-8892-1c9483ae8ef5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.482030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd71e7-a162-498e-a6ae-60798d834afa None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.482348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd71e7-a162-498e-a6ae-60798d834afa None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.482613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd71e7-a162-498e-a6ae-60798d834afa None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.484548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 43/86] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:34 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:34.487571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd71e7-a162-498e-a6ae-60798d834afa None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.494937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.496671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.497141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.497612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.506977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd71e7-a162-498e-a6ae-60798d834afa None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.513430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.514436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.514761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.515041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.516536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.518858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.520766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 44/88] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.521223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:34.521683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.522924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:34.532700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 45/89] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:34.533004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51755f1a-e22b-48ce-b97e-d7a4e53f6e37 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.534264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.544880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793093f-fa3a-432c-99f9-68225aeee45c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.546090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.547114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.547401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.547679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.551189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.552194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.552701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.552927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.553450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.554590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.555130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.555241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.556912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 45/90] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.557775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.563566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.567899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 46/91] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.567899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.578642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232b81f-5d56-4cb5-83a1-209d7d46a9d5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.581673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba2a6-1e15-4b26-a887-7097d8b3b1a6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.586529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.587314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.587673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.588011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.589543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.591015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.591601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.592048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.593645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.595827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.597924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:34.598079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.600308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.608296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.616013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 46/93] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:35:34.622606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.633418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb823-fda4-4432-9cf0-5635ff050f9e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.634997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98793322-e321-47a0-9209-0df869a9b880 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.638248 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.639150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.639426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.639776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] PATH_INFO: `/v3/projects/09544a37b0c442ff89cfde755049dc46` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.641051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=09544a37b0c442ff89cfde755049dc46)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.641600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.642488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.642970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.643342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.643673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.644661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.645127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/projects/09544a37b0c442ff89cfde755049dc46 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.646059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:34.646059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:34.646059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:34.656179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aac3dc-f894-4dba-8ea1-58814600c2ca admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.656398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:34.670498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b390a-fa2c-400a-bb22-4838d43cd8f8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:34.675558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:34.676410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:34.676880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:34.677252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:34.678795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=09544a37b0c442ff89cfde755049dc46, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:34.679314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:34.681944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6a48e-6999-4675-822a-befbc6ed3548 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:34.691522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 48/95] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:34 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=09544a37b0c442ff89cfde755049dc46&role.id=7a34713434094c19b43446fca1e27cf7 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:34.715166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 48/96] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:34 2021] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:37.063823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d73c-2ce0-4837-a707-d7b0d177095e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.064568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d73c-2ce0-4837-a707-d7b0d177095e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.064568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753d73c-2ce0-4837-a707-d7b0d177095e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.066547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 49/97] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:37.072294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9ccc-a079-4cd6-8da0-e1b179899c52 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.072826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9ccc-a079-4cd6-8da0-e1b179899c52 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.072981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b9ccc-a079-4cd6-8da0-e1b179899c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.097363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-059b9ccc-a079-4cd6-8da0-e1b179899c52 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:37.098637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-059b9ccc-a079-4cd6-8da0-e1b179899c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:37.106963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:37.116293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aef3b-9b5c-4184-8e4a-4f33a4c830e6 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.116616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aef3b-9b5c-4184-8e4a-4f33a4c830e6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.116864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aef3b-9b5c-4184-8e4a-4f33a4c830e6 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.119020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 50/99] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:37.125445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.125736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.126018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.136946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aef3b-9b5c-4184-8e4a-4f33a4c830e6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.166680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aef3b-9b5c-4184-8e4a-4f33a4c830e6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.173183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:37.174401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:37.181757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.182566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.182847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.183119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.191048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 50/100] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:37.209228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:37.216668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:37.222935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 51/101] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:37.224510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.224879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.236449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5b91b-5502-4881-806e-eb1d5cd7350d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.239416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24def4-251c-48bb-a044-9b56f173de2c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.246659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.247491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.247778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.248056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.250035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.250723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.251014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.251289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.253694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:37.254010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.255638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.274544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 52/102] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:37.275125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:37.282168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:37.288489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.292250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:37.294616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.299090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32f384-bf07-4ee4-8540-aa50c48198b7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.307365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2016f-e6dd-41a4-85b6-3c11e89d8ef5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.314735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.315596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.315884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.316176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.317299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.317976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.318254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.318526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.319304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:37.319603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.321283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.323591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.326270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.328138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:37.334861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.338386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 52/105] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:37.346115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cffc3-cfd5-4447-8445-0270408cf0be admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.346445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.358869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.359758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.360043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.360349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.361729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.363830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.367854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de82a0a-f0c4-449b-a779-5855a1ac6bb1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.373239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 54/106] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:37.377050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.383590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.384523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.384807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.385086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.387432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.389322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.394802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8af005-4eda-4b05-8e34-b8e08e92be0f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.395461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 53/107] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:37.397336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.407886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.408825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.409113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.409392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.412903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f0e36-fd7d-4196-98ec-97ce83eddfaa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.414252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, user_id=cf323fc13fa44d81bbf4d5fa93c483ac, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.417252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae79d3-705a-4b98-8301-49b2e205ce0c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.425431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.426389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.426714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.427032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.428321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.431384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.433109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 54/108] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:37.439010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 55/109] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:37 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:37.442130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.458712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ef22-2acc-4146-ab57-d163c44f8fb7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.519088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.520036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.520360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.520645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/413d9d96bebe4a659dd26ecc16805343/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.522789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, user_id=413d9d96bebe4a659dd26ecc16805343, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.523869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:35:37.523869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:35:37.523869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:35:37.526021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0d76a-09e3-45f2-ab8f-ef1e86e3e3ba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.546504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:37 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/413d9d96bebe4a659dd26ecc16805343/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:37.700283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818602a-c2eb-4f2d-86b3-0fcc468654bb None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.700769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818602a-c2eb-4f2d-86b3-0fcc468654bb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.700923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818602a-c2eb-4f2d-86b3-0fcc468654bb None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.702835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 56/111] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:37.709282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.709566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.709847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.735044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:37.736309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:37.813823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:37.851609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818602a-c2eb-4f2d-86b3-0fcc468654bb None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.864440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818602a-c2eb-4f2d-86b3-0fcc468654bb None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.868988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.869813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.870100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.870378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.883037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:37.890709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:37.892412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 57/113] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:37.901380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.911466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4700-56f8-47be-b069-101bd218dda0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.919624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.920691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.920981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.921264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.922119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:37.922432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.924302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.937447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:37.943797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.954337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7446c-9e61-4aa6-a353-5c699d68a13b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:37.965047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:37.966259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:37.966543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:37.966816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:37.968173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:37.970336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:37.971993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:37.978344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:37.991260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7296e-4a1b-43d3-80af-50b3a304f915 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.000985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.001880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.002168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.002497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] PATH_INFO: `/v3/projects/09544a37b0c442ff89cfde755049dc46` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.004247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=09544a37b0c442ff89cfde755049dc46)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.006620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838fe2f-141c-453d-a94e-c03888dda8b4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.008371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 58/116] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:37 2021] GET /identity/v3/projects/09544a37b0c442ff89cfde755049dc46 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:38.015290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.025726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dbd8-142b-4233-8ed2-a5f5a2d38ac3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.031360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.032362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.032646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.032919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] PATH_INFO: `/v3/projects/09544a37b0c442ff89cfde755049dc46/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.037173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=09544a37b0c442ff89cfde755049dc46, user_id=cf323fc13fa44d81bbf4d5fa93c483ac, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.039839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8166dc-f9ea-4619-a952-b3f8b71e20aa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.062591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 59/117] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:38 2021] PUT /identity/v3/projects/09544a37b0c442ff89cfde755049dc46/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:38.157286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105aa6-2e78-4c51-bad4-c21fdde5443a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.157903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105aa6-2e78-4c51-bad4-c21fdde5443a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.157903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105aa6-2e78-4c51-bad4-c21fdde5443a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.159937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 59/118] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:38.165903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.166427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.166593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.191521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:38.192832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:38.270880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 60/119] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:38.314621 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105aa6-2e78-4c51-bad4-c21fdde5443a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.330498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105aa6-2e78-4c51-bad4-c21fdde5443a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.337455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.338288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.338572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.338847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.353440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:38.361107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:38.367655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:38.369124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.379127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde9c5c-7fec-4b0a-80d4-91fc34ce1dd2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.389614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.390326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.390608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.390881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.391673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:38.391981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.393726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.408241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:38.409669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.421338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3aa9-98dd-400c-aadf-596209404bac admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.432371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.433266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.433547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.433891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.435203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.437428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.440433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:38 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:38.445513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.455529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec3e9-6638-4f27-9923-f330be1f7197 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.464543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.465584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.466020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.466294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.467543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.469683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf665e-7156-48b2-9923-b27ed6e43bea admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.471404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:38 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:38.478174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:38.493203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99e1c-7f79-4321-aaeb-47aa40714ee7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:38.501636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:38.502554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:38.502836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:38.503111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:38.505462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, user_id=cf323fc13fa44d81bbf4d5fa93c483ac, role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:38.508134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a1636-9023-4f2e-b6b6-01dc7bca73f5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:38.527500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:38 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/cf323fc13fa44d81bbf4d5fa93c483ac/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:39.375223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ea1f-a02d-4738-aa15-ce0430250fba None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.375965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ea1f-a02d-4738-aa15-ce0430250fba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.375965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ea1f-a02d-4738-aa15-ce0430250fba None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.378288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 63/125] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:39.390323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.391210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.391210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.418520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:39.420029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:39.501482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 63/126] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:39.557555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ea1f-a02d-4738-aa15-ce0430250fba None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.577947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ea1f-a02d-4738-aa15-ce0430250fba None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:39.582620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:39.583428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.583710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.583988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.588979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:39.591172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09002a-d31c-4b4f-8dbe-173e56154e11 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:39.593265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:39.599310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.612820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13791fc-22d0-41ca-8d61-fcd6f5e18f4c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.613114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13791fc-22d0-41ca-8d61-fcd6f5e18f4c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.613367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13791fc-22d0-41ca-8d61-fcd6f5e18f4c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.615148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 65/128] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:39.618530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f66b48-c3c3-4068-b9ec-abdfc663a1b4 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:39.623355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.623639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.623923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.629991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:39.630604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.630887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.631159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.631904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:39.633876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:39.664914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:39.666125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:39.689526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 64/129] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:35:39 2021] POST /identity/v3/projects => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:35:39.697467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 66/130] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:39.737321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.833301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e642-e242-4663-afcd-300d607c49ee admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:39.842221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:39.843056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.843345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.843625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.859361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:39.866436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:35:39.867708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 65/131] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:39 2021] GET /identity/v3/roles/reader => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:39.874755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.889089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413ea0d-7c14-4b39-96e6-010039815fe7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:39.899774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:39.900495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.900782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.901059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.901851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:39.902157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:39.904458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:39.915847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 67/132] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:39 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:39.922355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.933058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8a69f-f167-43bc-8ce7-143925ed8a41 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:39.943501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:39.944452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:39.944737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:39.945009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] PATH_INFO: `/v3/users/72c1515f6eeb42579b424afc55a2b36d` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:39.965147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] RBAC: Authorizing `identity:get_user(user_id=72c1515f6eeb42579b424afc55a2b36d)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:39.967388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:39.969206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 66/133] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:39 2021] GET /identity/v3/users/72c1515f6eeb42579b424afc55a2b36d => generated 289 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:39.976466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:39.994781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a017-23f8-4038-91b7-49235bde8229 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:40.012396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:40.013534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:40.014038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:40.014527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:40.030274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:40.030274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:40.040480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 68/134] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:40.047204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:40.067101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295cba3-3ff0-4617-b824-eeb698f9c112 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:40.076450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:40.077344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:40.077632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:40.077910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:40.082207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:40.084365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8397b2-f28f-40c2-81c5-1181e343fe62 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:40.086276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 67/135] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:40 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:40.097014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:40.109580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4354a-bec7-4150-8f23-c5faf9a64e14 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:40.120049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:40.121311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:40.121829 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:40.122370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:40.123542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=72c1515f6eeb42579b424afc55a2b36d) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:40.124087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:40.126600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7d3a-de0e-46e9-8564-327df15a141d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:40.133073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 69/136] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:40 2021] GET /identity/v3/role_assignments?user.id=72c1515f6eeb42579b424afc55a2b36d&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:41.153853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4fb36-9e7b-4479-900c-e66a8bb476f3 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.155029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4fb36-9e7b-4479-900c-e66a8bb476f3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.155556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4fb36-9e7b-4479-900c-e66a8bb476f3 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.157902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 68/137] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:41.163938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.164392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.164566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.196364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:41.197566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:41.209567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 70/138] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:41.245495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4fb36-9e7b-4479-900c-e66a8bb476f3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.265576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4fb36-9e7b-4479-900c-e66a8bb476f3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.272716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.273752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.274229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.274694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.289098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:41.300506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:41.302021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 69/139] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:41.308486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.321165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae4e0-bac2-448f-9922-f80022b1f897 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.331804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.332531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.332827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.333107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.334017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:41.334336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.336201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.346369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 71/140] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:41.352748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.363976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1aaae-6158-4001-879f-24403c5e0bfc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.378076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.379207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.379695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.380174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.381595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.383995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.390203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 70/141] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:41.395953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.409403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34df0d-65eb-408a-9f7a-863a31f58126 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.419917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.420621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.420908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.421191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.429827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.431583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.445600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 72/142] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:41.452119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.474790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec673f-5e3e-4823-b6ce-ba1d66e63ad2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.489825 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.490712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.491056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.491343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.497025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.499269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b063c-b546-44ba-a309-f468aaefc4c5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.501855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 71/143] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:41.508834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.521965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e3c5-0736-4d71-bff2-67e54f2657d3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.532294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.533083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.533374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.533659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.534524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:41.534841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.536728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197edf4-89e6-4b86-a578-4f15674e9e83 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.543220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 73/144] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=7a34713434094c19b43446fca1e27cf7 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:41.729299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d9a-0076-4d8c-9e2e-ac1768c29653 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.729920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d9a-0076-4d8c-9e2e-ac1768c29653 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.730392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f560d9a-0076-4d8c-9e2e-ac1768c29653 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.732184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310b67-f0dc-48b0-bd70-30995dad9653 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.732712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310b67-f0dc-48b0-bd70-30995dad9653 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.733179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42310b67-f0dc-48b0-bd70-30995dad9653 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.735308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 74/145] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:41.737785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 72/146] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:41 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:41.741989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.742682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.743153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.746705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.747323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.747814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.790845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:41.792119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:41.793638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:41.795186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:41.814731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 73/147] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:41.820656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:41.854876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.861340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.873723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f4164-c61a-4bb5-9a60-6f6b85fc87e9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.877218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c87e5-cd52-4074-ad5f-d3fb59d40058 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.884004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.885171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.886259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.887232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.887755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.888777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.889781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.890423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.913144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:41.920861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:41.921682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:41.929131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:41.930667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 74/149] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:41.932108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 76/150] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:41.937292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.938785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:41.954669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe41cb-192c-4388-bddb-6bb8f7be29cb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.958902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6a8e8-2f1a-4da5-b25a-16a212ddc8ab admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:41.964766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.966365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.967666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.968456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:41.969031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.969876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:41.970900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:41.971387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:41.971847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:41.972397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.974180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:41.975536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.976072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:41.979753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:41.993352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 77/151] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:41.999650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 75/152] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:41.999963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.004952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.016946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2f3a-83ee-4f4b-bd94-38d71e9dba4a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.019615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d1ed7-d82d-4514-9ebd-5be5f8d1e95f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.026795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.027770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.028061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.028365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] PATH_INFO: `/v3/users/413d9d96bebe4a659dd26ecc16805343` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.030027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.030874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.031149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.031422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.036882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] RBAC: Authorizing `identity:get_user(user_id=413d9d96bebe4a659dd26ecc16805343)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.036882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.037790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 76/153] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/users/413d9d96bebe4a659dd26ecc16805343 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:42.038595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.040794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.042458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 78/154] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:41 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:42.044317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.048674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.061981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51a969-7b9a-4031-a77e-4b24938be866 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.064688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fa4d-335e-41e5-aaf4-6bee51eb2fdc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.071596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.072288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.072575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.072852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.075039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.075766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.076051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.076355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.088272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.090398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.093322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.095321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.103351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 77/155] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:42.109513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.111485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 79/156] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:35:42.117570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.118741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855f347-7ac7-4b1f-8a11-1364157b8a50 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.123412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.124668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.124962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.125243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.126507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.128721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.130467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 78/157] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:42.131975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a1a5b-af1a-4c04-9e4e-19983260f351 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.137278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.145687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.146564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.146845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.147118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] PATH_INFO: `/v3/projects/09544a37b0c442ff89cfde755049dc46` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.148842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dec38-5e9e-4fc3-8d25-fcdaa8d5f20d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.149024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] RBAC: Authorizing `identity:get_project(project_id=09544a37b0c442ff89cfde755049dc46)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.150917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.152726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 80/158] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/projects/09544a37b0c442ff89cfde755049dc46 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:42.154127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.154842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.155133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.155465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.156400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=413d9d96bebe4a659dd26ecc16805343) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:42.156770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.158792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aedf2-4de2-46ed-aa37-da540d522f93 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.161268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.165824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 79/159] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/role_assignments?user.id=413d9d96bebe4a659dd26ecc16805343&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:42.182993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99729bd5-0e25-4766-b2f6-8037342e8588 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.199082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.202840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.203173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.203399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.204351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=09544a37b0c442ff89cfde755049dc46, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:42.204666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.208329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d84a-0e0f-4570-b211-c06c69825d4b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.222157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 81/160] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=09544a37b0c442ff89cfde755049dc46&role.id=7a34713434094c19b43446fca1e27cf7 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:42.261919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf02b0-0c49-42fc-b35f-d6960a5e8c8c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.262254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf02b0-0c49-42fc-b35f-d6960a5e8c8c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.262549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf02b0-0c49-42fc-b35f-d6960a5e8c8c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.264845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 80/161] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:42.274543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.274856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.275097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.305498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:42.306751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:42.315013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 82/162] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:42.351553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf02b0-0c49-42fc-b35f-d6960a5e8c8c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.367722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf02b0-0c49-42fc-b35f-d6960a5e8c8c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.372361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.373227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.373559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.373849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.392051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:42.399835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:42.401142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 81/163] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:42.407795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.422062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a476-42be-4632-abe3-860b9b6d3512 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.437035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.437748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.438028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.438302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.439108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:42.439416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.441129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.454669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 83/164] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:42.461199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.472185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbb05-c23d-467c-9398-d34ae5723861 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.476838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.477793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.478077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.478349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] PATH_INFO: `/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.479719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] RBAC: Authorizing `identity:get_user(user_id=cf323fc13fa44d81bbf4d5fa93c483ac)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.482236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.486285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 82/165] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/users/cf323fc13fa44d81bbf4d5fa93c483ac => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:42.490529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.505545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbadafc-8bc8-4818-9562-d70a2d93a88a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.510934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.511607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.512380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.512694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.523740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.525530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.535041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 84/166] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:42.541258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.554542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec58518-7e56-4542-964e-74780b1b1cfe admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.562072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.562998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.563309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.563610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.568329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.570453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87285da3-a273-45da-9ea4-12f46ef529e3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.572450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 83/167] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:42.578919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:42.589394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2fe5e-d010-4111-a8c6-7e25ea7a4ae0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:42.597189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:42.597962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:42.598253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:42.598573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:42.599527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=cf323fc13fa44d81bbf4d5fa93c483ac) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:42.599870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:42.602338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171afca-ab79-46bf-8721-5b82aca08907 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:42.612980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 85/168] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:42 2021] GET /identity/v3/role_assignments?user.id=cf323fc13fa44d81bbf4d5fa93c483ac&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:43.366935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b61d2-c595-4b21-b0f5-fd4c514b265a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.367510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b61d2-c595-4b21-b0f5-fd4c514b265a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.367510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b61d2-c595-4b21-b0f5-fd4c514b265a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.369328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 84/169] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:43.375534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.375964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.376180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.395880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:43.397082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:43.406009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 86/170] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:43.429125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b61d2-c595-4b21-b0f5-fd4c514b265a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.443437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b61d2-c595-4b21-b0f5-fd4c514b265a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.448631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.449442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.449724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.449992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.460497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:43.467377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a507f1ab-309a-4819-9cee-36c92b05f01d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:35:43.468598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 85/171] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:43.474718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.483909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d43e4-8a2c-4e83-956a-da68d5d93e11 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.484227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d43e4-8a2c-4e83-956a-da68d5d93e11 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.484504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d43e4-8a2c-4e83-956a-da68d5d93e11 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.484593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16170dcd-14ff-44bc-a135-ec15ebe62e4b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.486960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 86/172] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:43.491035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.491706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.491989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.492075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.492295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.492383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.492629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.493069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:43.493377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.495084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.504608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:43.510680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.510871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:43.512090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:43.520015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 87/174] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:43.520565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c928d90-a624-4f92-b9bc-37d40de0dcfa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.525767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.526590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.526872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.527143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] PATH_INFO: `/v3/users/72c1515f6eeb42579b424afc55a2b36d` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.528526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] RBAC: Authorizing `identity:get_user(user_id=72c1515f6eeb42579b424afc55a2b36d)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.530640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.532373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 88/175] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:43 2021] GET /identity/v3/users/72c1515f6eeb42579b424afc55a2b36d => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:43.537982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.548374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.548871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa9d9-1db9-4932-b3ab-f9495f2c2060 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.555383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.556258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.556540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.556806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.558004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.560375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b163bc2-d5b7-405e-8e93-23a711b9fcee admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.562429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.564105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 88/176] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:43 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:43.564919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.565757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.566038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.566306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.567481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.571649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.571763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.571856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 89/177] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:43.577468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:43.581016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7f99-176d-49ed-9723-773bb1d6bbfd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.585755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.586272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.586554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.586827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/72c1515f6eeb42579b424afc55a2b36d/roles/1e0ed86e470e4b06b4abc7ccdf8334c9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.586916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367158e-be51-42a6-ba2b-73e6cf08a621 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:43.588782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, user_id=72c1515f6eeb42579b424afc55a2b36d, role_id=1e0ed86e470e4b06b4abc7ccdf8334c9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.591604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a71e-27f4-4d02-aa5f-13b83ccbe82a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.591922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:43.592592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:43.592871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:43.593141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:43.593867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:43.595734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f2dac-2cb2-46e6-98f6-bcdc22f8cf77 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:43.605955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 89/178] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:43 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/users/72c1515f6eeb42579b424afc55a2b36d/roles/1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:43.618006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 90/179] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:43 2021] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:46.366552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439773-8087-416c-9cde-b001e338ca9b None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.367581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439773-8087-416c-9cde-b001e338ca9b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.368061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439773-8087-416c-9cde-b001e338ca9b None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.370163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 90/180] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:46.370534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931847a-e402-45d2-9cdf-419bd423bd9a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.370920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931847a-e402-45d2-9cdf-419bd423bd9a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.371288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931847a-e402-45d2-9cdf-419bd423bd9a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.373138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 91/181] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:46.379286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.379617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.379855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.381331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.381823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.382303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.411568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:46.412814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:46.414543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:46.415699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:46.505852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 91/182] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:46.519697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 92/183] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:46.552000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.557248 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.569600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ab4d6-296f-41d3-a628-d9251aba3dde None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.571746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f19f4-1321-4787-9105-110020023af6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.578448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.578448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.578448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.578448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.584626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.585448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.585726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.585993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.601928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:46.613663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:46.620907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:35:46.622182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 93/184] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:46.625141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:46.626774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 92/185] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:46.632843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.634425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.644603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea90f-a7a5-4ac7-8aaa-e3c07bc6b27b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.649519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.650192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.650472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.650746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.651662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:46.651994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.653781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.654515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1ed68-f716-4dcd-bfaa-f502c4adac5e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.663429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 93/186] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:46.665361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.666040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.666318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.666590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.667363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:46.667665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.669726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.675388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.682892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3166c-92aa-422c-a802-b286d5e533d1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.691094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 94/187] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.693920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.694787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.695062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.695384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] PATH_INFO: `/v3/users/72c1515f6eeb42579b424afc55a2b36d` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.697015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.702516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] RBAC: Authorizing `identity:get_user(user_id=72c1515f6eeb42579b424afc55a2b36d)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.705803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.707479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 94/188] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/users/72c1515f6eeb42579b424afc55a2b36d => generated 289 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:46.711533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c314b-462d-426f-95e9-8f90387c7619 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.713924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.721898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.722816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.723099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.723365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.731823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acabb5f-3036-4929-a8b6-bc58c9df3650 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.744133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.744822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.745099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.745376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.755876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.758041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.759745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 95/189] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:46.763584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.765421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.769167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.774948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 95/190] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:46.781222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.782601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ee53-d2e3-4ef6-b122-5b00a2a462f8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.790374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0b42-793c-46de-bde4-8d2485036361 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.795014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.795873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.796161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.796439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.797898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.800024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.800812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.801484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.801770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.802010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.802107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.808069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.815900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.817690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b47481-a55a-448b-97d0-f73a66bda417 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.825028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27a54c-546b-488f-bf1d-6c5dcf69420f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.831455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.832115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.832439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.832718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.833584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa, user.id=72c1515f6eeb42579b424afc55a2b36d) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:46.833909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.835778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fecbf-19a8-400f-83f3-c72c0bce554c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.836346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 96/192] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:46.837973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751e5e-5549-471b-be7b-3222b0f9ba7d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.838486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751e5e-5549-471b-be7b-3222b0f9ba7d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.838950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751e5e-5549-471b-be7b-3222b0f9ba7d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.840938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 97/193] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:46.843458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 97/194] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/role_assignments?user.id=72c1515f6eeb42579b424afc55a2b36d&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.845054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a751e5e-5549-471b-be7b-3222b0f9ba7d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.848877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.849432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.849907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.876165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:46.878029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:46.883519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a751e5e-5549-471b-be7b-3222b0f9ba7d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.892954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.895917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.896449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.897039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.898590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.901047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aab060-74b0-44e9-ab56-90387d8c3bc3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.901268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 98/195] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:46.903505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 98/196] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.910004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.926443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44c48-c862-47e3-bed5-1cdc6b116218 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.926886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8422f-f8bc-4edd-b143-a0d3958f6dec None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.927272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44c48-c862-47e3-bed5-1cdc6b116218 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.927861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44c48-c862-47e3-bed5-1cdc6b116218 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.930219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 99/197] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:46.937597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.938287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.938757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.943134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.943818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.944099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.944479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.945359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:46.945674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.947845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.955597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 99/198] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.956779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.961215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:46.962774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:46.967135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c8afd-0555-4dcd-ad39-9b9c8be79c19 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:46.971875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:46.972784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:46.973066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:46.973350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:46.973640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 100/199] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:46.980185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:46.980185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:46.980749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:46.986943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:46.997607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9694da-3ad0-4713-87a2-f99715c5208e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.000744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.004039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.005172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.005661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.006156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.007146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.009479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.011749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfa891-04ba-4430-aaf0-878965eae674 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.016574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.017522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.017808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.018084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.032262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:47.040372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fe0bee05-395a-46b7-806b-aaedd4cc48d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:47.041955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 101/201] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:47.043215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16cc3-2912-4395-95e4-123f79060935 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.043520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16cc3-2912-4395-95e4-123f79060935 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.043710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16cc3-2912-4395-95e4-123f79060935 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.045603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 102/202] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:47.052604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.052980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.053158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.054445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 101/203] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:46 2021] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:47.060644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.072799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e254bc-f958-4555-9e2c-71a0c60b1c88 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.078908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.080288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.080879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.081522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.082622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:47.083183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.085247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.096378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:47.096810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 102/204] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:47.100372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:47.104413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.109779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 103/205] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:47.117512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ec1e-a9fa-4e14-8a6f-5338f51ddd40 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.123025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.124882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.125395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.125930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.127767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.130654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.133283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 103/206] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:47.138865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.140291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.146023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed2d0d-6d04-4d4f-9fff-cd2ede473203 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.151380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.152420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.152718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.152990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.153833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1abc-ff61-4fb2-89bd-d05cfb40c8f0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.165050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.166201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.166695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.167226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.175154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:47.181749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.183676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.185597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:47.187189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 104/207] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:47.198010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.201005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 104/208] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:47.208736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.218897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d624c9-6a46-4c10-914d-b975de07b150 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.220134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1645a-1234-41e8-87e8-bb5bda7aa417 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.225727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.226638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.226920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.227199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.229547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.231663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.233627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 105/209] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:47.233919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.234900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.235385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.235943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.237086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:47.237612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.239907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.240300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.258506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 105/210] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:47.258716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988b3c-abb1-4943-a753-d1ddefb871d5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.265192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.270047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.270826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.271414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.271704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.273339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:47.273667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.275878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.276602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098935-8ddb-436d-903b-55f7d3596004 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.282400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 106/211] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:47.283250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.284261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.284557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.284863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.286199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.288702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.290894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 106/212] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:47.301389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.314572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e582-f610-41ed-b15d-e22d0de081bf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.322394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.323076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.323358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.323635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.336042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.337920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.348476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 107/213] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:47.355238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.372283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f244ca-e36e-4d5c-9da1-48e3deaf2452 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.378231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.379098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.379396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.379673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.381146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.383242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214178d-aea1-4e0e-907a-1e3909c54116 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.385552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:47.392632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:47.405396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3386b5-8d85-4fca-b0c6-4d5d4d4892d1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:47.409876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:47.410568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:47.410849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:47.411119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:47.411975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:47.412342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:47.414211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16a786-49ff-4a8f-9494-56088db155c8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:47.423542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 108/215] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:47 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:49.946892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438614fc-d718-4505-8f3a-eaba1a943209 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:49.947423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438614fc-d718-4505-8f3a-eaba1a943209 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:49.947423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438614fc-d718-4505-8f3a-eaba1a943209 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:49.949625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 108/216] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:49.955630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:49.956036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:49.956238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:49.978758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:49.979965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:49.992247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 109/217] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:50.028425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438614fc-d718-4505-8f3a-eaba1a943209 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.046134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438614fc-d718-4505-8f3a-eaba1a943209 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.050406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.051227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.051508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.051782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.068746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:50.076221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:50.077515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 109/218] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:35:50.083877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.093701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d50cb-0c59-4115-ac2f-44df6ac684c8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.098163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.098858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.099141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.099415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.104234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:50.104756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.106642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddcf5b-a3e3-4281-8832-924334234273 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.115891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 110/219] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.122525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.138800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9e182-533b-4d21-baa9-71fb9eadf10d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.143240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.144145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.144450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.144720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.145967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.148441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6cba-9c59-4df4-ad14-4c2c20072c5d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.148734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6cba-9c59-4df4-ad14-4c2c20072c5d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.149010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6cba-9c59-4df4-ad14-4c2c20072c5d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.150816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 111/220] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:35:50.152585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.154266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 110/221] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:50.161428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.161997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.161997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.167441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.172810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac907257-4644-4a59-9cec-ac85251a4546 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.185763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.186898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.187376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.187844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.189325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.191616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.193812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 111/222] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.197425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:50.198515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:50.201398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.212665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b26d1-d9e0-4ceb-a8d6-ae3685ec14ef admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.214790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 112/223] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:50.217752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.218902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.219424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.219894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.222136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, user_id=3d6c4a81d4d2466eaa5de59479050fb8, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.225037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f5251-56ba-4b9f-88db-015f6eec61f8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.246898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.250056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:50 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:50.259525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c2fd-fd59-49c5-b26e-a7d58bd0b5a7 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.260135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c2fd-fd59-49c5-b26e-a7d58bd0b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.260680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c2fd-fd59-49c5-b26e-a7d58bd0b5a7 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.263473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 113/225] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:50.264756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122f58b-77f7-45fc-a8d2-982e32f0e1cb None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.279360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b21c-81db-4353-95ca-62f90ac5075f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.279989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b21c-81db-4353-95ca-62f90ac5075f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.280610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279b21c-81db-4353-95ca-62f90ac5075f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.312072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b279b21c-81db-4353-95ca-62f90ac5075f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:50.315049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b279b21c-81db-4353-95ca-62f90ac5075f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:50.363787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.365655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.366171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.366669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.382315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:50.388923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 114/226] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:50.396178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:50.396392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689f37-95e6-4388-a400-63124cffb46d None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.396392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689f37-95e6-4388-a400-63124cffb46d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.396392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689f37-95e6-4388-a400-63124cffb46d None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.396392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 115/227] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:50.398447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 113/228] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:50.399426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.399778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.400061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.404751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.427764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8081f-c438-4270-805b-c0159b696834 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.432523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.433239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.433599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.433902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.434766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:50.435076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.435922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:50.436748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.437724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:50.446088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 116/229] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:35:50.447282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 114/230] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:50.447559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.453772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.462517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b4b9-2492-46c2-a336-6dd8b40cfea0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.465944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b41b2-90b9-4b56-89ec-7a1d297315f8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.474670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.476887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.477402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.477926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.478728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.479720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.480002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.480344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.481644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.483949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b02c9-18cc-481a-ac67-8108fbec4b1c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.485770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 115/231] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:50.487044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1c8d-b2f9-4cc7-ae03-257a6e494d55 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.487472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1c8d-b2f9-4cc7-ae03-257a6e494d55 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.487635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1c8d-b2f9-4cc7-ae03-257a6e494d55 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.489385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 116/232] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:50.492963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1c8d-b2f9-4cc7-ae03-257a6e494d55 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.494982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:50.502456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:50.503706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:50.504555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.510634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1c8d-b2f9-4cc7-ae03-257a6e494d55 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.515147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6806f-5491-4261-be25-15240539327c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.515612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.516457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.516740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.517014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.519703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.520575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.521555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.521555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.522315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.524386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e8db-b985-415d-b490-039ebd39dfd7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.526196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 118/234] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.527279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.527566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.527846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.528621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:50.535938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:50.537176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 117/235] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:50.542411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.548321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f24ebd-faeb-4203-a85f-eebeb176a644 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.548775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:50.550047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:50.552845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.553532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.553814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.554090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.554896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:50.555174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.556831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.558533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 119/236] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:50.559225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.575942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a247a-29ad-4be5-bfc0-52b26f6367bf None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.576412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 118/237] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.582044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.587597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.589220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.589509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.589823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.590722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799dcfe-0c82-4c1a-90fd-8956c1272cf1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.591903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, user_id=3d6c4a81d4d2466eaa5de59479050fb8, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.594587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.595067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.595752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.596032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.596350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.597129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:50.597433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.599011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.607799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 119/238] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.612316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.612455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:50 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:50.612455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.629570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d7244-a51e-4235-b1bd-b9e31a70c851 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.693247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71487602-99ea-4a25-b4cf-fadc6a37fed0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.698497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.699638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.700122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.700600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.702050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.704097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.706583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 121/240] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.707675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.714551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.715954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.716371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.716745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] PATH_INFO: `/v3/users/2f6d211ca59648579e7a5a8b90f9fc48` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.722779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935474c-d14c-4958-a3d0-0c852579bf0c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.728507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.729899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.730509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.731227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.733069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.735764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.737929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 122/241] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.738932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.748309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2f6d211ca59648579e7a5a8b90f9fc48)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.752019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.754224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 120/242] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/users/2f6d211ca59648579e7a5a8b90f9fc48 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.759617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe283f-9f87-4229-9e07-ce7dfaa62eb3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.759825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.767782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.768878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.769379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.769831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.770806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.771186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5ab6-1410-4b81-ac65-a2a214304da8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.773602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.776112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.777264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.777724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.778099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.779526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.781758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.787387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 121/243] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.788574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.802293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 123/244] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:50 2021] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:50.803418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.805299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d5f6c-55b2-49c8-9e63-3f37df6e0b56 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.824020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.825136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.825632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.826125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.828631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb930c-16b4-4fdb-a598-68523ec7bf04 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.841991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.844370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.845425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.845818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.846188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.848058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.854381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, user_id=3d6c4a81d4d2466eaa5de59479050fb8, role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.857446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.862810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 122/245] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:50.869846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.880760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa37cb-aec8-46b0-9ced-93aa0e5b9c69 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.902636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 124/246] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:50 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/3d6c4a81d4d2466eaa5de59479050fb8/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:50.946891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.947791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.948124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.948469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.949832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.952011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d093-16d4-4fa1-bfd7-4b6915498909 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.954339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 123/247] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:50.960741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:50.971778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e60fa-4572-4f61-92f2-0d2e34f1b9bb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:50.976729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:50.977426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:50.977713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:50.977992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:50.978888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=2f6d211ca59648579e7a5a8b90f9fc48) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:50.979206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:50.981305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd258f3-ecd0-4506-8353-0833a7e93bb4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:50.988388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 125/248] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:50 2021] GET /identity/v3/role_assignments?user.id=2f6d211ca59648579e7a5a8b90f9fc48&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.241007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc3a-fb13-4db5-89e6-316d9740eb3d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.241590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc3a-fb13-4db5-89e6-316d9740eb3d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.241590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc3a-fb13-4db5-89e6-316d9740eb3d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.243354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 124/249] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:53.258784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.259422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.259422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.289209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:53.290418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:53.298507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 126/250] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:53.335544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adcc3a-fb13-4db5-89e6-316d9740eb3d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.354856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adcc3a-fb13-4db5-89e6-316d9740eb3d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.362281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.363095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.363388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.363664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.381477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:53.388753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:53.390052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 125/251] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:53.397710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.407312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdbe31-5e92-47d4-b80d-89f783afc31e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.416479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.417195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.417480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.417792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.418670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:53.418981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.420830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.435013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 127/252] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.441223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.458588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456595c-8b71-46f5-8b2b-fc6f215d9fa6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.466763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.467658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.467938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.468250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.469497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.471669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.473530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 126/253] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.479383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.489676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e2cf-d959-4496-91b0-332f1e8a6530 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.504858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.505473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.505751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.506026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.519836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.521689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.533967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 128/254] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:53.539795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.554254 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30e20-f4c8-4366-9263-4ce39f027a41 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.569465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.570400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.570688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.570965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.581387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.583622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d88f3-bff3-4040-80cc-dfff3f252d28 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.585786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 127/255] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.591997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.605620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b1cab-d1aa-4610-b592-1b574420832c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.616677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.617377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.617665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.617941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.618817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:53.619131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.621139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87555c36-cb90-46e3-ad6d-008050d1725d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.633658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 129/256] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.668745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddeac7-c9cd-4e56-8947-b1d328547fdf None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.668745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddeac7-c9cd-4e56-8947-b1d328547fdf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.668745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddeac7-c9cd-4e56-8947-b1d328547fdf None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.668745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 128/257] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:53.678052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.678052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.678052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.696283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:53.697808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:53.706039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 130/258] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:53.730211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddeac7-c9cd-4e56-8947-b1d328547fdf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.743308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddeac7-c9cd-4e56-8947-b1d328547fdf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.748407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.749861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.750320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.750797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.763654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:53.771042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:53.778503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 129/259] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:53.780259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.790047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef424944-7ae3-47eb-b620-217049de7741 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.795253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.796302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.796783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.797305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.798365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:53.798868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.800851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.816457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 131/260] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.818249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.828871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a82a94-6817-417e-bd23-8b196f888a19 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.834325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.835783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.836298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.836775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] PATH_INFO: `/v3/users/2f6d211ca59648579e7a5a8b90f9fc48` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.838350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] RBAC: Authorizing `identity:get_user(user_id=2f6d211ca59648579e7a5a8b90f9fc48)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.841036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.846046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 130/261] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/users/2f6d211ca59648579e7a5a8b90f9fc48 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.850423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.865755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e693c0-ead5-4609-a853-de0db754d5f1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.870988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.872407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.872950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.873417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.875346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.877753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6a18-9788-4c16-9a65-dcd7c127f554 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.879804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 132/262] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:53 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:53.886552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:53.898140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90c762-0597-43e8-9cf4-91d3d5ea1b8a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:53.903121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:53.904556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:53.904981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:53.905444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/2f6d211ca59648579e7a5a8b90f9fc48/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:53.908444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, user_id=2f6d211ca59648579e7a5a8b90f9fc48, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:53.911528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb48bf5-215c-4842-a739-090bfc857131 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:53.928447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 131/263] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:53 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/2f6d211ca59648579e7a5a8b90f9fc48/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:54.049751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3eb-9fda-4087-baf6-6e02d83a1d6d None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.050369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3eb-9fda-4087-baf6-6e02d83a1d6d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.050790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032e3eb-9fda-4087-baf6-6e02d83a1d6d None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.053295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 133/264] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:54.059671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeb4e1-bd56-48cf-bec6-a8ed2eace8ff None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.060217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeb4e1-bd56-48cf-bec6-a8ed2eace8ff None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.060651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeb4e1-bd56-48cf-bec6-a8ed2eace8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.082451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7ddeb4e1-bd56-48cf-bec6-a8ed2eace8ff None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:54.083877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7ddeb4e1-bd56-48cf-bec6-a8ed2eace8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:54.151679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 132/265] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:54.195959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e3eb-9fda-4087-baf6-6e02d83a1d6d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.209990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032e3eb-9fda-4087-baf6-6e02d83a1d6d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.215202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.216333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.216757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.217218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.229863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:54.237375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:35:54.238945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 134/266] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:54.245348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26303-b3c4-4430-924c-2867995ed17b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.245921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.246462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26303-b3c4-4430-924c-2867995ed17b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.246954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd26303-b3c4-4430-924c-2867995ed17b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.249434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 133/267] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:54.260215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.260932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.261428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.262134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2e85-ef52-4c6f-b0c2-70314de0347d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.271882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.272605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.272890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.273163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.274911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:54.275121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.277746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.287034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:54.288240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:54.295237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 135/268] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:54.300934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.309125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 134/269] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:54.315853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f07ab9-29b3-41de-804c-ef59bc6d4597 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.320564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.321695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.322197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.322668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.324281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.326652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.328526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 136/270] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:54.339764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.339929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.348979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab4e41-21c7-4778-8e36-7457b67b6825 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.349168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565467c-5ab5-486b-8118-23cd989f75aa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.357467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.358073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.358354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.358622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.359754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.360581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.360854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.361118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.371154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.372983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.376864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:54.384579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 135/271] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:54.384997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:35:54.386216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 137/272] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:54.391040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.396083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.408420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f242b-e804-4b88-971e-61d75a5708a7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.414189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe95c-b0ac-428d-8562-c66c5237e910 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.415720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.416687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.417025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.417332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.418645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.420899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.422652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 136/273] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:54.426309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.426998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.427280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.427550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.428654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:54.428904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.429004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.430712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.444924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdd0e8-9f2a-41da-b751-3bac7c2d1a60 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.450084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 138/274] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:54.452576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.453292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.453575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.453850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.454758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:54.455887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.461046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.463229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.467947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aecea-c3da-413b-b13e-3bada5e3c7e9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.472368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.474415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.475480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.475859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] PATH_INFO: `/v3/users/3d6c4a81d4d2466eaa5de59479050fb8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.476552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:54.485381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6c4a81d4d2466eaa5de59479050fb8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.487993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.490101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/users/3d6c4a81d4d2466eaa5de59479050fb8 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:54.496843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.510987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5228c9-520f-4eed-bee6-592bb473a0d2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.516416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.517083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.517367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.517643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.530012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.531988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.543083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 138/277] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:54.549090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.561088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5bba0-4a76-4b5e-8af0-57d11a8954a8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.574132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.575105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.580762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.581054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.585120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.587307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2addf-7b37-4b02-85db-8d52409204ae admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.589202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:54.596025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:54.605933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41d90-f189-441e-8b95-16bf9b48348c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:54.616821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:54.617529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:54.617862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:54.618139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:54.619068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=3d6c4a81d4d2466eaa5de59479050fb8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:54.619381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:54.621583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f889e-c7e4-452d-97f4-68d6eeb19c4a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:54.633419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 139/279] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:54 2021] GET /identity/v3/role_assignments?user.id=3d6c4a81d4d2466eaa5de59479050fb8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:55.030366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f315348-dbc9-4595-acac-518c00d60082 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.030721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f315348-dbc9-4595-acac-518c00d60082 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.030903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f315348-dbc9-4595-acac-518c00d60082 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.032650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 141/280] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:55.039066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.039351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.039625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.067003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:55.068226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:55.077869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 140/281] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:55.103746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f315348-dbc9-4595-acac-518c00d60082 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.127365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f315348-dbc9-4595-acac-518c00d60082 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.138442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.139255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.139539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.139821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.166816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:55.174215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:35:55.175480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 142/282] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:55.184745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.193475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c086dab-0540-4eef-8740-686075df6bf2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.200126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.201180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.201695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.202170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.203146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:55.203650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.205673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.215588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 141/283] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:55.221849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.235169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250469c-1c93-4284-a9b2-f85edb5b53f3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.241388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.242341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.242620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.242938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] PATH_INFO: `/v3/users/a4986dee23f349a7908fd459041926bb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.259038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4986dee23f349a7908fd459041926bb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.261240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.264234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 143/284] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/users/a4986dee23f349a7908fd459041926bb => generated 297 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:55.270262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.281347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd21f1-c9b0-42a7-9150-0ee5ca0151a5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.290090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.290090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.290090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.290090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.298780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.300565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.316262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 142/285] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:55.321492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.331441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc04e51-eadb-470d-8faa-d85ac3a14133 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.335835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.336721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.337001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.337274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.338471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.340590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c541b80-9af8-4aa4-9380-b7896e8f9d02 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.342563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 144/286] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:55.348893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.358795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594b557-fa5c-4557-b295-7942046a7963 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.363138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.363788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.364066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.364370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.365236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=a4986dee23f349a7908fd459041926bb) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:55.365540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.367368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe538f87-841b-4cef-a229-737edaa4a6d4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.379169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 143/287] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/role_assignments?user.id=a4986dee23f349a7908fd459041926bb&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:55.453126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6806-96e5-479a-915e-2b59e9c0cafa None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.453479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6806-96e5-479a-915e-2b59e9c0cafa None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.453655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6806-96e5-479a-915e-2b59e9c0cafa None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.455738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 145/288] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:55.462088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.462356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.462653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.481894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:55.483113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:55.491071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 144/289] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:55.517385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f6806-96e5-479a-915e-2b59e9c0cafa None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.530555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f6806-96e5-479a-915e-2b59e9c0cafa None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.535348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.536073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.536404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.536656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.537939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.539680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf29800-c85e-4962-a010-df591b1339f8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.541597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 146/290] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:55.547909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:55.557620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dafa9-32be-4425-8655-54c3ba91d597 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:55.562501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:55.563211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:55.563490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:55.563771 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:55.569016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:55.569016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b725fb-61c3-4349-92f0-a0f5aafc3cce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:55.592859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 145/291] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:55 2021] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:35:56.661840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4c1b-d8c7-4a42-89ab-934f8941dcc2 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.662360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4c1b-d8c7-4a42-89ab-934f8941dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.662440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4c1b-d8c7-4a42-89ab-934f8941dcc2 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.664333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 147/292] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:56.670385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.670857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.671029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.688526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:56.689697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:56.697578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:56.721963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4c1b-d8c7-4a42-89ab-934f8941dcc2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.734426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4c1b-d8c7-4a42-89ab-934f8941dcc2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.738710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.739522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.739800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.740070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.751383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:56.758218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:56.759517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 148/294] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:56.766096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.775599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44ed5-103f-49dd-a954-41236c6ef763 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.780093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.780804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.781085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.781363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.782130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:56.782433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:56.784031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:56.793590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 147/295] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:56.799596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.810294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3285e6-29d1-46e3-af69-b1ac8c68bee1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.814660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.815523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.815802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.816074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] PATH_INFO: `/v3/users/2f6d211ca59648579e7a5a8b90f9fc48` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.817369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] RBAC: Authorizing `identity:get_user(user_id=2f6d211ca59648579e7a5a8b90f9fc48)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:56.819707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:56.821308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 149/296] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/users/2f6d211ca59648579e7a5a8b90f9fc48 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:56.830490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.841228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e27f-1d6b-4fdb-9d45-d5a6df72ba7b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.845901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.846573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.846854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.847139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.856472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:56.858299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:56.869148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 148/297] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:35:56.876084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.885952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a497-2f58-4b11-86ba-64e411e17dea admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.890424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.891293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.891572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.891843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.893069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:56.895156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab842439-4a44-4999-9dd3-c7c495c78187 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:56.896852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 150/298] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:56.903553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:56.912846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374f93f-92f7-4847-944a-068c6c1dd565 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:56.917217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:56.917939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:56.918223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:56.918503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:56.919342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=2f6d211ca59648579e7a5a8b90f9fc48) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:56.919702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:56.921727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7755b3-1b12-4b01-989c-2d3680e6076c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:56.927975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 149/299] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:35:56 2021] GET /identity/v3/role_assignments?user.id=2f6d211ca59648579e7a5a8b90f9fc48&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:57.814646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960ae4-ec42-46c5-9c7b-e95844b5b3a9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:57.815173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960ae4-ec42-46c5-9c7b-e95844b5b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:57.815173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a960ae4-ec42-46c5-9c7b-e95844b5b3a9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:57.817172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 151/300] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:57.822909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:57.823308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:57.823383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:57.841959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:57.843214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:57.853083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 150/301] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:57.876987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a960ae4-ec42-46c5-9c7b-e95844b5b3a9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:57.889709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a960ae4-ec42-46c5-9c7b-e95844b5b3a9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:57.894387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:57.895180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:57.895462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:57.895743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:57.906517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:57.913440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:35:57.914810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 152/302] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:57.921102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:57.930629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2231fc-7576-4aec-98d5-bc1886cbac72 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:57.935817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:57.936661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:57.937011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:57.937357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:57.938362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:57.938729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:57.940410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:57.949494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 151/303] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:57.955678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:57.965762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bef569-d63a-4b5e-ae58-eb7e02301c24 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:57.970159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:57.971105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:57.971479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:57.971913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] PATH_INFO: `/v3/users/a4986dee23f349a7908fd459041926bb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:57.973172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] RBAC: Authorizing `identity:get_user(user_id=a4986dee23f349a7908fd459041926bb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:57.975302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:57.977119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 153/304] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:57 2021] GET /identity/v3/users/a4986dee23f349a7908fd459041926bb => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:57.983074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:57.993565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad96ee-c4b8-4fe2-be73-9f72709c5d99 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:57.999810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.000703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.001000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.001272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.002462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.004532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96248b98-7a3a-47d9-abea-c02b37abd316 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.006531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 152/305] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:35:57 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:58.013663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.024123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea128b5-f080-4add-82c6-a421a9d45565 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.029814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.030719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.031109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.031364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/a4986dee23f349a7908fd459041926bb/roles/1e0ed86e470e4b06b4abc7ccdf8334c9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.033463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, user_id=a4986dee23f349a7908fd459041926bb, role_id=1e0ed86e470e4b06b4abc7ccdf8334c9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.036084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84860b-526a-42f8-ae3d-5ac01984c158 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.051265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 154/306] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:35:58 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/users/a4986dee23f349a7908fd459041926bb/roles/1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:35:58.078609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486f52-650f-4d25-b8c9-76cc851705b8 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.079350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486f52-650f-4d25-b8c9-76cc851705b8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.079819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486f52-650f-4d25-b8c9-76cc851705b8 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.082531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 153/307] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:58.088934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.089302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.089575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.108346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:58.109600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:58.113532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feab5b-e108-4386-a3e9-d571487a0ca2 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.113876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feab5b-e108-4386-a3e9-d571487a0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.114153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5feab5b-e108-4386-a3e9-d571487a0ca2 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.116220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 154/308] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:35:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:35:58.122504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.122835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.123058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.142395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:35:58.143595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:35:58.178840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 155/309] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:58.205104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.216253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b5d55-9a83-474e-8c81-8aa700b1b046 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.227125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 155/310] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:35:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:35:58.227980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.228930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.229224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.229501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.241750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:35:58.249518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:35:58.249982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.251076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 156/311] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:35:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:35:58.258221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.261378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9803c-c867-4b03-825f-7dc5622081d9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.266755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.267549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.267833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.268123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.269391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.271073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ae2f-0ad7-41e1-9285-874c583e0c70 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.271203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.272940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 156/312] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:35:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:58.277191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.278220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.278531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.278805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.279376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.279617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:58.279936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.281744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.292090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafa5f-98d4-4176-91ba-309bf76be932 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.293066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:35:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:35:58.299830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.301584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.302234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.302516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.302792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.303526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.305664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.310222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03edcb8-13c0-4ed9-b7d9-0218c1a5b1a8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.314952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.316052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.316442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.317052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] PATH_INFO: `/v3/users/a5219635024047b19bbaae37abd93f32` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.332325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 157/314] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:35:58 2021] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:35:58.336380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] RBAC: Authorizing `identity:get_user(user_id=a5219635024047b19bbaae37abd93f32)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.338867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83a3ac-cac3-44a7-9309-1c66038bb124 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.341069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:35:58 2021] GET /identity/v3/users/a5219635024047b19bbaae37abd93f32 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:35:58.347691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:35:58.358887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f56e9c-ba6b-4296-997b-e214d113e789 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:35:58.363578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:35:58.364352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:35:58.364636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:35:58.364908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:35:58.365797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, user.id=a5219635024047b19bbaae37abd93f32, scope.system=all) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:35:58.366110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:35:58.368031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ad18-89cb-4103-b0f5-9a4365bd0045 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:35:58.378578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 158/316] 10.222.0.36 () {56 vars in 1329 bytes} [Thu Nov 25 04:35:58 2021] GET /identity/v3/role_assignments?user.id=a5219635024047b19bbaae37abd93f32&scope.system=all&role.id=7a34713434094c19b43446fca1e27cf7 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.472828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7106cec-d36b-4129-aa09-c6548df8447e None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.473368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7106cec-d36b-4129-aa09-c6548df8447e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.473368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7106cec-d36b-4129-aa09-c6548df8447e None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.475360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 159/317] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:00.481602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.482074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.482148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.501225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:00.502420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:00.510217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 159/318] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:00.534581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7106cec-d36b-4129-aa09-c6548df8447e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.547452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7106cec-d36b-4129-aa09-c6548df8447e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.552237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.553297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.553777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.554238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.565912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:00.573044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:36:00.574649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 160/319] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:00.582973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.591256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db70482-245d-4a04-a60c-7f7f3de1ccb8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.595703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.596390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.596674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.596946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.597709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:00.598012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.599595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.608635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 160/320] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.614727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.624998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36accfe-6285-4569-b554-35439c4f0a41 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.629542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.630404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.630684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.630959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] PATH_INFO: `/v3/users/a4986dee23f349a7908fd459041926bb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.632194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] RBAC: Authorizing `identity:get_user(user_id=a4986dee23f349a7908fd459041926bb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.634343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.635989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 161/321] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/users/a4986dee23f349a7908fd459041926bb => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.642437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.652827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59db37-fe77-450a-a08b-28a83d14097d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.657398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.658228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.658705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.659145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.667733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.669838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.679578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 161/322] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:00.686118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.696553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331bdd-fca1-43d6-8242-5bacc793e7ea admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.701182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.702215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.702666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.703130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.704549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.706792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a31cf0-4a1c-4686-ae49-581bd14be5c0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.708978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 162/323] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.715484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.724604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895149-0902-4d76-9524-55adcc3165f9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.729065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.729812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.730186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.730540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.731495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, scope.project.id=574d09a8a9f84702aebd0649fb13013a, user.id=a4986dee23f349a7908fd459041926bb) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:00.731883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.733818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936bc5a-ad2a-4375-abcc-61c8b8ec7787 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.740333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 162/324] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/role_assignments?user.id=a4986dee23f349a7908fd459041926bb&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.771410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452ed8-7355-40d0-8771-3b9992c89eba None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.771766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452ed8-7355-40d0-8771-3b9992c89eba None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.772078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452ed8-7355-40d0-8771-3b9992c89eba None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.774032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 163/325] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:00.780885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fceae9-1377-4e71-9a76-aee4793de96d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.781170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fceae9-1377-4e71-9a76-aee4793de96d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.781448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fceae9-1377-4e71-9a76-aee4793de96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.800376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f3fceae9-1377-4e71-9a76-aee4793de96d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:00.801599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f3fceae9-1377-4e71-9a76-aee4793de96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:00.809967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 163/326] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:00.834436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08452ed8-7355-40d0-8771-3b9992c89eba None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.847468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08452ed8-7355-40d0-8771-3b9992c89eba None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.852026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6c83-b8ce-43e5-b249-9ccccd4dd8a0 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.852297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.852510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6c83-b8ce-43e5-b249-9ccccd4dd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.852858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df6c83-b8ce-43e5-b249-9ccccd4dd8a0 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.853124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.853407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.853680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.854929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 164/327] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:00.861096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8956-add5-41a4-8e0b-eb523791f6f4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.861464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8956-add5-41a4-8e0b-eb523791f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.861813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa8956-add5-41a4-8e0b-eb523791f6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.867324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:00.875014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:00.876317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:00.883657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.883858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-cbaa8956-add5-41a4-8e0b-eb523791f6f4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:00.885066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cbaa8956-add5-41a4-8e0b-eb523791f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:00.894052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 165/329] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:00.896032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c657-15f5-45e3-a715-ffd14246ee48 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.900699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.901609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.902182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.903256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.904332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:00.904646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.905615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2040-26eb-4f86-ae3c-0df29db4d457 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.905910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2040-26eb-4f86-ae3c-0df29db4d457 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.906189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed2040-26eb-4f86-ae3c-0df29db4d457 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.906344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.908388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 166/330] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:00.915213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.915494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.915765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.919147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 165/331] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:00.925137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.935463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679cae6-a906-4af7-8ace-0d96ffc7f5c7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.935847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:00.937079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:00.940090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.940987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.941279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.941557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.942810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.944616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.945301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 167/332] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:00.946484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 166/333] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:00.949674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.953131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.966384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1ad8-b6a9-4220-ae1a-9ae62e7d39a7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.967104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14181497-39eb-46e9-a7f0-63a535a42fba None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:00.970851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.971538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.971822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.972100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] PATH_INFO: `/v3/groups` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.972226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:00.972853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.973096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:00.973384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:00.973655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] PATH_INFO: `/v3/users/a5219635024047b19bbaae37abd93f32` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:00.973890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:00.973890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:00.973890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:00.974925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] RBAC: Authorizing `identity:get_user(user_id=a5219635024047b19bbaae37abd93f32)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:00.975077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.977035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:00.978671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 168/334] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/users/a5219635024047b19bbaae37abd93f32 => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:00.985190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.996193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 167/335] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Nov 25 04:36:00 2021] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:00.996193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:00.996539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffcf1-0dbb-43e8-8885-e0138774d42f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:01.001933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:01.002872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:01.003225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:01.003739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:01.007912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a76126-6e4f-4196-97fb-502af6798dc3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:01.013288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:01.014200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:01.014493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:01.014778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] PATH_INFO: `/v3/system/users/a5219635024047b19bbaae37abd93f32/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:01.016522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a5219635024047b19bbaae37abd93f32, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:01.017601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:01.017601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:01.017601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:01.018022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:01.018497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:01.026298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:36:01.027855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 169/336] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:01.033503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 168/337] 10.222.0.36 () {58 vars in 1355 bytes} [Thu Nov 25 04:36:00 2021] PUT /identity/v3/system/users/a5219635024047b19bbaae37abd93f32/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:01.036624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:01.048142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3b43f-92fa-4ca1-ba68-33d2e20a3588 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:01.053043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:01.053850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:01.054265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:01.054628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:01.055538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:01.055927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:01.057709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:01.068882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 170/338] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:01 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:01.075751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:01.087031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49747-36e7-4f7c-ae3b-e73d9e575382 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:01.097396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:01.098465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:01.098823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:01.099175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] PATH_INFO: `/v3/users/2d7c886eb6b14889bcb6fb9feb566126` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:01.118385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d7c886eb6b14889bcb6fb9feb566126)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:01.120787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa0e30-cd2f-463a-8025-010e49a83ce9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:01.123244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 169/339] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:01 2021] GET /identity/v3/users/2d7c886eb6b14889bcb6fb9feb566126 => generated 293 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:01.130222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:01.142739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae43147-1ae0-48d5-9ff8-f45a6414ca83 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:01.147858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:01.148677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:01.148955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:01.149274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:01.150173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, user.id=2d7c886eb6b14889bcb6fb9feb566126, scope.system=all) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:01.150480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:01.152567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d2cba-56f0-401d-b3f8-87325d4f9cbd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:01.158883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 171/340] 10.222.0.36 () {56 vars in 1329 bytes} [Thu Nov 25 04:36:01 2021] GET /identity/v3/role_assignments?user.id=2d7c886eb6b14889bcb6fb9feb566126&scope.system=all&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.436108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6b94-099c-460a-a5df-9334335401ce None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.436733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6b94-099c-460a-a5df-9334335401ce None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.436733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6b94-099c-460a-a5df-9334335401ce None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.438653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 170/341] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:03.442462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d372-0d4f-4ae7-8aa1-df2c4e85bf06 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.442916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d372-0d4f-4ae7-8aa1-df2c4e85bf06 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.443115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d372-0d4f-4ae7-8aa1-df2c4e85bf06 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.444610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.444898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 172/342] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:03.445148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.445492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.450856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.451148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.451425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.465860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:03.467059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:03.469186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:03.470351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:03.474654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 171/343] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:03.478277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 173/344] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:03.498435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.503016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.508321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0e530-263e-4e8a-82b6-1858cc61958a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.512178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18902b-aafb-4ba4-908a-0a9d01ecbedd None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.513007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.513822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.514109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.514386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.515587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.516814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.517310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540ed5b-3f2f-4553-b46b-d6b067b56f2d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.517610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.517893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.518170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.518924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 172/345] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.520103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7193b-c891-44b1-a2f7-fe48c61128cb None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.520412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7193b-c891-44b1-a2f7-fe48c61128cb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.520682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7193b-c891-44b1-a2f7-fe48c61128cb None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.522291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 173/346] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:03.525076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7193b-c891-44b1-a2f7-fe48c61128cb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.533596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:03.536990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7193b-c891-44b1-a2f7-fe48c61128cb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.540437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-ab518358-f0ef-4909-ac0e-1a9595b2f1f9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:03.541150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.541759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 174/347] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:03.541870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.542113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.542408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] PATH_INFO: `/v3/groups` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.542894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.543226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.543325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.543490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.545290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.564318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 174/348] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Nov 25 04:36:03 2021] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:03.564318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.564608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:03.564608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:03.575064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedb4f9-c112-470a-8394-c91bc8b83779 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.580252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.581000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.581289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.581566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.582379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:03.582695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.583992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 175/349] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:03.584403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.594482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 175/350] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.600831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.609879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.611827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc8f8-0d81-4776-b25b-f2fd5819962d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.616500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.617449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.617736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.618015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] PATH_INFO: `/v3/users/a5219635024047b19bbaae37abd93f32` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.619392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] RBAC: Authorizing `identity:get_user(user_id=a5219635024047b19bbaae37abd93f32)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.621235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a852fed-0542-4661-ac6e-5017f91208ea admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.621720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.629295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 176/351] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/users/a5219635024047b19bbaae37abd93f32 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.629527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.629527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.629527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.629527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.631223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.640864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:03.643835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7169-c87f-4ee8-a078-233a665ad8ef admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.648031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:36:03.648835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.649652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 176/352] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:03.650005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.650293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.650572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.651452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] RBAC: Adding query filter params (role.id=7a34713434094c19b43446fca1e27cf7, user.id=a5219635024047b19bbaae37abd93f32, scope.system=all) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:03.651766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.653874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.656068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.666511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c816-96cf-44bd-bb3e-f998b6de5a1d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.670397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 177/353] 10.222.0.36 () {56 vars in 1329 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/role_assignments?user.id=a5219635024047b19bbaae37abd93f32&scope.system=all&role.id=7a34713434094c19b43446fca1e27cf7 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:03.680346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.680346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.680346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.680346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.680705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:03.680705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.680705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.685757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 177/354] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.692863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.704023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7b51-2107-40c6-b156-f0d5977f6530 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.709486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.710436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.710738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.710971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] PATH_INFO: `/v3/users/2d7c886eb6b14889bcb6fb9feb566126` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.712507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] RBAC: Authorizing `identity:get_user(user_id=2d7c886eb6b14889bcb6fb9feb566126)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.714827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbeda9-dca2-431a-838c-7ee08cd94afc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.716772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:03 2021] GET /identity/v3/users/2d7c886eb6b14889bcb6fb9feb566126 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:03.723383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:03.734256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17fc93-30cb-411e-be46-75c7bcd2216e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:03.739545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:03.740531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:03.740795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:03.741090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] PATH_INFO: `/v3/system/users/2d7c886eb6b14889bcb6fb9feb566126/roles/1e0ed86e470e4b06b4abc7ccdf8334c9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:03.742890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d7c886eb6b14889bcb6fb9feb566126, role_id=1e0ed86e470e4b06b4abc7ccdf8334c9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:03.744648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd37b-53b4-42eb-b8cc-092985aa4f10 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:03.754902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 178/356] 10.222.0.36 () {58 vars in 1355 bytes} [Thu Nov 25 04:36:03 2021] PUT /identity/v3/system/users/2d7c886eb6b14889bcb6fb9feb566126/roles/1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:06.647681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d81af-be8f-433c-b776-fa8a1b42a458 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.648277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d81af-be8f-433c-b776-fa8a1b42a458 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.648277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d81af-be8f-433c-b776-fa8a1b42a458 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.650336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 179/357] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:06.656201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.656657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.656730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.672015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee8469-0d88-4db8-9cf0-734f86536766 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.672354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee8469-0d88-4db8-9cf0-734f86536766 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.672608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee8469-0d88-4db8-9cf0-734f86536766 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.674598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 180/358] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:06.675547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:06.676855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:06.680587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.680876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.681153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.689515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 179/359] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:06.700852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:06.702125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:06.710143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 181/360] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:06.718964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.733354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728bb10-095b-4b6d-b76d-e00527675f79 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.736589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.739193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.739997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.740315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.740589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.746088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f5fbf-56e3-4924-99e7-81a59e6ddb76 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.751839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.752759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.753127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.753464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.761139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:06.766553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:06.768090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:06.773723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 25 04:36:06.774846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 180/361] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:06.775214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 182/362] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:06.775783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.781542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.789259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297949-8af0-44fa-af83-3fcac6ed04fb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.793557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6904d5-9935-45dd-9c4d-0165108351d0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.798239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.799066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.799418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.799761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.800641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:06.800989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.801156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.801666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.801947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.802222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.802907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39dcec-6490-45b4-953f-34ac26d16a32 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.803063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:06.803281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.804890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.814476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 183/363] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:06.815923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479c7-dad9-4ff3-a427-ede6b186d394 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.816760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 181/364] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:06.820450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479c7-dad9-4ff3-a427-ede6b186d394 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.820768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479c7-dad9-4ff3-a427-ede6b186d394 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.822731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 184/365] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:06 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:06.823302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.824620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920479c7-dad9-4ff3-a427-ede6b186d394 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.837877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920479c7-dad9-4ff3-a427-ede6b186d394 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.839618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878311-b9cc-467a-967d-32bd4d47424a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.844522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.845593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.845960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.846246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] PATH_INFO: `/v3/users/2d7c886eb6b14889bcb6fb9feb566126` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.847492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d7c886eb6b14889bcb6fb9feb566126)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.849750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446a9cc-0be2-4b58-95a6-d529c7137c62 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.851634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 185/366] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/users/2d7c886eb6b14889bcb6fb9feb566126 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:06.852348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.852683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.852970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.853129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.853277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.853415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.853560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.868760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.870626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.878404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:06.879810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:06.888533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 186/367] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:06.889518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.891049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 182/368] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:06.896910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.900648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf52a9-4a66-4069-99e4-ee7944840432 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.906288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.907326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.907788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.908267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.909311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] RBAC: Adding query filter params (role.id=1e0ed86e470e4b06b4abc7ccdf8334c9, user.id=2d7c886eb6b14889bcb6fb9feb566126, scope.system=all) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:06.909805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.911839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.914515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a6766-b421-4d9c-9bf6-a8b14efa0874 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.926292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 187/369] 10.222.0.36 () {56 vars in 1329 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/role_assignments?user.id=2d7c886eb6b14889bcb6fb9feb566126&scope.system=all&role.id=1e0ed86e470e4b06b4abc7ccdf8334c9 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:06.928179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.928179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.928371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.929181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.931295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.932042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.933533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:06.936309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 183/370] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:06.941128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.945749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c341c-c8c0-475d-9999-9fceb40cdc87 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.952499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.954187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.954668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.955386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.957252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96585b-ff59-47fc-a836-e2ae2f9af680 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:06.973603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:06.974484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:06.974767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:06.975041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:06.976018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:06.984011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:06.985854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 188/371] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:06.992691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:06.997712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:06.999079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:06.999079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:06.999079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:07.000325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.002302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 184/372] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:07.008528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.010671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972cd3f-2dd4-4da1-8186-584fe0f744ad admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.020228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.021836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.022304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.022908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.023962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:07.024482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.025309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c750-50ce-4ada-820f-8e89dd820126 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.026556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d23f9-5f59-4592-a603-849d4510e347 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.033795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.034547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.034829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.035101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.035952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:07.036298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.037985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 189/373] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:07.038168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a5a8f-22c8-4ded-9ed2-0851e2e78ec9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.039654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992d43-22fc-49af-b593-9e5661618600 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.040378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992d43-22fc-49af-b593-9e5661618600 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.040872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992d43-22fc-49af-b593-9e5661618600 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.043013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 190/374] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:07.044251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992d43-22fc-49af-b593-9e5661618600 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.051939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 185/375] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:07.058136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992d43-22fc-49af-b593-9e5661618600 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.059845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.060115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.060415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.069206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.070395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.070973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.071509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.086089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.087860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.101451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:07.102691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:07.112047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 191/376] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:07.118164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.123077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 186/377] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:07.131837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0c5e-d8ee-45e4-84a0-a72055d401f2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.146613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.147501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.147781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.148054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.153136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.155219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.157057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 192/378] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:07.163570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.167762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.181700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e137385-35b4-43e9-861f-b5cc4650165e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.181899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f8f0-51a0-4d25-9bd0-378cecfec5a6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.197074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.197926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.198213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.198481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.199327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.200265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.200542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.200817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.205172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.207246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.209407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 187/379] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:07.216811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:07.231058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:07.232746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 193/380] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:07.233189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.244222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.255600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45230a9-4cc3-400e-8e9b-f9bdca0991c7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.258704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912482-1c4a-4dff-86f9-4950d6757ee7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.273279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.273975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.274253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.274525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.275319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:07.275620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.277698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.280593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.281281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.281560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.281835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.282692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:07.283000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.284903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.291363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 194/381] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:07.297378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 188/382] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=7a34713434094c19b43446fca1e27cf7 => generated 260 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:07.301868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.317309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3681-cea2-4de6-8e25-6c2850a2e247 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.331867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.332500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.332782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.333049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.342455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.348362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.359750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 195/383] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:07.367310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.385831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95556c2-e9af-4e5d-884b-07c9810d54d0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.402215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.403116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.403398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.403671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.406207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.408415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.410263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:07.417083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.436904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646e9d-598a-4b46-98be-785a335f7d96 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.443200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.444080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.444387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.444662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.449934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.450983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:07.450983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:07.450983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:07.452220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c758f-492a-4949-8f33-3f364e9f27fd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.454307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 196/385] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:07.460930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:07.479225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106536-5c89-4f2e-b226-3ef349b20138 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:07.488021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:07.488021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:07.488021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:07.488021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:07.488864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:07.492371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:07.492371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfc6e8-9555-4a4b-bdd8-627725811eff admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:07.499484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 190/386] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:07 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:08.138915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013113-db63-4ad1-8d9d-98c7fe0e58f6 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.139464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013113-db63-4ad1-8d9d-98c7fe0e58f6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.139464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5013113-db63-4ad1-8d9d-98c7fe0e58f6 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.141260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 197/387] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:08.147544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.148446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.148932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.178882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:08.180504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:08.188536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 191/388] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:08.221967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013113-db63-4ad1-8d9d-98c7fe0e58f6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.237986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5013113-db63-4ad1-8d9d-98c7fe0e58f6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.242694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.243745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.244249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.244752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.260663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:08.268291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:08.269719 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 198/389] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:08.276006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.285723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9542-2e61-45c3-aa41-3702b850814a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.290449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.291363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.291863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.292412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.293536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:08.294040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:08.295843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:08.305413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:08.311370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.327275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32be8f5-847b-4f1a-a699-ec315ec66607 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.332236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.333201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.333702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.334198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.347887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:08.350195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:08.366772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:08.373234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.383999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58e862-b599-49db-8cf7-ad3e1cbf7f09 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.393851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.395074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.395575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.396095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.397527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:08.400024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:08.402574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 193/392] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:08.408330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.418014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75028454-9e9f-4bdb-a93e-5fe06ee7149c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.423909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.424801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.425083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.425354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.428900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:08.430807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67f72d-6d8e-4e2a-81cb-7b4473d55947 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:08.432448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 200/393] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:08.439107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.449901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a0c5-b354-48de-9d1a-b31fb5f54da3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:08.454665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:08.455643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.460241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.460852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.461948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=574d09a8a9f84702aebd0649fb13013a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:08.462470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:08.464748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff0c59-a5e2-408c-8709-c37f3fba8c90 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:08.471392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 194/394] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:08.891429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af963-404f-4d5f-b2f7-efd7ae5c0c19 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.891828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af963-404f-4d5f-b2f7-efd7ae5c0c19 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.892042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af963-404f-4d5f-b2f7-efd7ae5c0c19 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.893828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 201/395] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:08.900113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:08.900714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:08.901192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:08.925484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:08.927115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:08.935210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 195/396] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:08.983025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af963-404f-4d5f-b2f7-efd7ae5c0c19 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:08.998365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af963-404f-4d5f-b2f7-efd7ae5c0c19 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.008114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.008934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.009216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.009491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.025145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:09.032119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:09.033565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 202/397] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:09.039629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:09.049204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425f3d2-c894-47b6-a740-adacc3c2421c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.058427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.059424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.059909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.060430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.061402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:09.061927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:09.063773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:09.074306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 196/398] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:09.080433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:09.094219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd52e6-b146-4bd2-bd6c-95ff7909858f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.106251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.106916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.107195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.107467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.120622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:09.122385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:09.138164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 203/399] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:09.143906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:09.161910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4ba62-72f6-4c3d-a4df-ab11b4fe7d64 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.167432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.168875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.169444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.169977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] PATH_INFO: `/v3/projects/eecafb0e45fb4de69b43e46178412ed9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.171426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] RBAC: Authorizing `identity:get_project(project_id=eecafb0e45fb4de69b43e46178412ed9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:09.173588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:09.175828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 197/400] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:09 2021] GET /identity/v3/projects/eecafb0e45fb4de69b43e46178412ed9 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:09.181526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:09.197235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ffd9-ff83-4c28-9f03-b93d7c4e9b3f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.204111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.205012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.205271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.205542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] PATH_INFO: `/v3/groups/5f992ddc40f3481988f3b25408c00127` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.218571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] RBAC: Authorizing `identity:get_group(group_id=5f992ddc40f3481988f3b25408c00127)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:09.220499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473a78-c686-43c1-b0ef-0bdf750aaad7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:09.222187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 204/401] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:09 2021] GET /identity/v3/groups/5f992ddc40f3481988f3b25408c00127 => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:09.228576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:09.239294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70646a-d1ee-4619-a3e2-e5305a740e49 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:09.249251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:09.250238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:09.250720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:09.251218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:09.252347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] RBAC: Adding query filter params (group.id=5f992ddc40f3481988f3b25408c00127, role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=eecafb0e45fb4de69b43e46178412ed9) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:09.252920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:09.254987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244fb1-123c-4d2c-aa9e-ae33515e5d48 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:09.263689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 198/402] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:09 2021] GET /identity/v3/role_assignments?group.id=5f992ddc40f3481988f3b25408c00127&scope.project.id=eecafb0e45fb4de69b43e46178412ed9&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.344490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb149a-1eba-45d1-91ae-d662e05dfbba None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.345568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb149a-1eba-45d1-91ae-d662e05dfbba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.346065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb149a-1eba-45d1-91ae-d662e05dfbba None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.348082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd3c34-288e-4fbb-9766-b7e1cddd9141 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.348489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd3c34-288e-4fbb-9766-b7e1cddd9141 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.348675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd3c34-288e-4fbb-9766-b7e1cddd9141 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.348871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 205/403] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:10.350649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 199/404] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:10.355506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.356037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.356555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.357055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.357340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.357617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.389699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:10.390876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:10.396289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:10.397421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:10.410511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 200/405] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:10.410791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 206/406] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:10.433802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.442924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8146e-42ee-41d8-81ce-7c666fdb6862 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.450797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.452594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.453403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.453681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.453949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.464387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027ac12-164a-428d-bb1a-5ea4750db056 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.471804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:10.481118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:10.482770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 201/407] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:10.488613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.488916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.489853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.490131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.490401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.499068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6245ab-6d02-4bbf-945b-9fcee5e57772 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.503472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.504176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.504567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.504841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.505658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:10.505969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.507608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.509724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:10.517515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 202/408] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:10.523745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.525994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:10.528461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 207/409] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:10.534619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98b2a6-e713-45e7-8beb-fe57dae0986b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.534837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.541760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.542738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.543019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.543316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.544650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.546601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.548235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 203/410] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:10.550800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c1135-8904-430c-bf8e-2ed1f60c56bb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.554557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.564780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.565492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.565807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.566050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.566863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:10.567158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.568835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8f278-9a5b-444c-a190-791917ea3a9f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.571342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27833b-8f7a-4561-920b-4820d76e98fc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.579816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 208/411] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.581633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482900f8-0610-428b-ac58-07853a7f8399 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.581789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.582262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482900f8-0610-428b-ac58-07853a7f8399 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.582707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482900f8-0610-428b-ac58-07853a7f8399 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.582920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.583276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.585279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 209/412] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:10.588540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.589562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482900f8-0610-428b-ac58-07853a7f8399 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.591180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.595176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8f705-3750-44c1-a3d7-9183a74b0da1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.596854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 204/413] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:10.601381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.601671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.601952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.612548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482900f8-0610-428b-ac58-07853a7f8399 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.618037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.619437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.619941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.620545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.622124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.622916 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:10.624522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:10.624990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.627320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 210/414] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.633107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.641711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 205/415] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:10.642796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.644879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fdce3-d68a-4e6e-9f01-662e3aab176c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.648985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.650114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.650533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.650947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/groups/d9106d6b59824569963ac622bf9438e8/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.655701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d01c8-3226-4e41-a74f-7e407653ce6a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.657785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, group_id=d9106d6b59824569963ac622bf9438e8, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.660843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.660969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.662013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.662491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.662979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.664401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.666622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.668875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 206/416] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.675266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.683455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 211/417] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Nov 25 04:36:10 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/groups/d9106d6b59824569963ac622bf9438e8/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:10.686341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ffcb6-fff0-407e-9784-7550666c9535 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.707081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.755717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.757073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.757586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.758072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/groups/d9106d6b59824569963ac622bf9438e8/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.760387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, group_id=d9106d6b59824569963ac622bf9438e8, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.763468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.789474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 207/418] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Nov 25 04:36:10 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/groups/d9106d6b59824569963ac622bf9438e8/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:10.801803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e33a8-f2fd-42ee-885d-8e4c6d7035e9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.867823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.868623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.868914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.869188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.882559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:10.890372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:10.891636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 212/419] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:10.898516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.909406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69c087-948d-4474-a582-0b00639ffc7b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.914375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.915187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.915473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.915747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.916642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:10.916949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.918717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.932743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 208/420] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.935276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.946076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367440-58a9-45d5-bc00-b743f934b3a9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.951168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.952088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.952404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.952679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.953971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.955987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.963163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 213/421] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.964998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:10.975481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361337ef-e822-4c99-aa6a-d50d92e97d37 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:10.980541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:10.981505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:10.981843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:10.982118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:10.983525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:10.985789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504f1e-b19b-4570-88db-c7d4976b5bfc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:10.992322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 209/422] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:10 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:10.994658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:11.005571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456083-9076-4d6b-98d0-241d539289ca admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:11.010415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:11.011436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:11.011763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:11.012038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/groups/d9106d6b59824569963ac622bf9438e8/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:11.014535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfccf3a4b984f68b07f792b4eda21aa, group_id=d9106d6b59824569963ac622bf9438e8, role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:11.017392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f12659-2b2e-4cd8-966e-e66da42456b1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:11.040658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 214/423] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Nov 25 04:36:10 2021] PUT /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa/groups/d9106d6b59824569963ac622bf9438e8/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:12.045961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e976ad-6add-4a7d-9505-6f9964d9390f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.046491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e976ad-6add-4a7d-9505-6f9964d9390f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.046491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e976ad-6add-4a7d-9505-6f9964d9390f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.048554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 210/424] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:12.065766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.066280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.066354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.088477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:12.089900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:12.170313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 215/425] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:12.203860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e976ad-6add-4a7d-9505-6f9964d9390f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.220850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e976ad-6add-4a7d-9505-6f9964d9390f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.225417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.226240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.226521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.226797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.240100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:12.247548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:12.251471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 211/426] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:12.255725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.265171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095a15-8682-4f2b-8846-1f91fc155da7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.272266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.272960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.273245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.273520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.274319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:12.274624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.276257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.290158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 216/427] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.291429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.302744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f5cef-b1bb-4df2-a657-41488f06a649 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.310094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.310964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.311253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.311533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.312824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.314804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.317583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 212/428] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.322798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.333089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c315-5daa-4c50-a7d3-5bd43f886803 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.341851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.342839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.343125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.343400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.344707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.346886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07335cb-d785-447c-883c-cb3786bf860e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.348840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 217/429] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.355522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.366127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf6f45-332e-4fd2-965c-51e71e697ea6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.375453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.376696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.377211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.377705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a/groups/d9106d6b59824569963ac622bf9438e8/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.380333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=574d09a8a9f84702aebd0649fb13013a, group_id=d9106d6b59824569963ac622bf9438e8, role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.383560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50115ddf-0ea6-4897-8652-2726cd41484b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.407534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 213/430] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Nov 25 04:36:12 2021] PUT /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a/groups/d9106d6b59824569963ac622bf9438e8/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:12.490635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ad6f-9d7a-4c30-b7fe-50437012b7cf None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.490949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ad6f-9d7a-4c30-b7fe-50437012b7cf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.491197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ad6f-9d7a-4c30-b7fe-50437012b7cf None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.493463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 218/431] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:12.503328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.503646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.503895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.526325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:12.527681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:12.609590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 214/432] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:12.648475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ad6f-9d7a-4c30-b7fe-50437012b7cf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.670067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ad6f-9d7a-4c30-b7fe-50437012b7cf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.677863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.679060 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.679573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.680077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.699296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:12.706697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:12.708676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 219/433] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:12.715429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.729582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b11f50-0db9-4c53-b530-1cedb7699c0c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.745086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.745885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.746175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.746450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.747260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:12.747563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.749599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.759387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 215/434] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.765976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.781521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293afbe-2a68-4f22-a3a6-8b9618e7eac6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.788050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.789206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.789725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.790188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] PATH_INFO: `/v3/groups/5f992ddc40f3481988f3b25408c00127` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.791638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] RBAC: Authorizing `identity:get_group(group_id=5f992ddc40f3481988f3b25408c00127)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.793814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.797008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 220/435] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/groups/5f992ddc40f3481988f3b25408c00127 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.802267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.812499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89529ee-b2dd-454a-832e-17eea667c7e0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.817426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.818551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.819111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.819577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] PATH_INFO: `/v3/projects/eecafb0e45fb4de69b43e46178412ed9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.821056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] RBAC: Authorizing `identity:get_project(project_id=eecafb0e45fb4de69b43e46178412ed9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.823153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721d346-fe91-46de-9d92-d6735d285393 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.830813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 216/436] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:12 2021] GET /identity/v3/projects/eecafb0e45fb4de69b43e46178412ed9 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:12.832432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:12.843299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcd62-60db-4f27-8486-9802517f4a85 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:12.848272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:12.849500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:12.850022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:12.850486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] PATH_INFO: `/v3/projects/eecafb0e45fb4de69b43e46178412ed9/groups/5f992ddc40f3481988f3b25408c00127/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:12.852771 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecafb0e45fb4de69b43e46178412ed9, group_id=5f992ddc40f3481988f3b25408c00127, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:12.855867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02febb8b-49c6-4195-8010-bc4d70152cd0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:12.874665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Nov 25 04:36:12 2021] PUT /identity/v3/projects/eecafb0e45fb4de69b43e46178412ed9/groups/5f992ddc40f3481988f3b25408c00127/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:13.811128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc292c-cfbe-4b82-81ef-68bfbfce76e8 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:13.812281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc292c-cfbe-4b82-81ef-68bfbfce76e8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:13.812804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc292c-cfbe-4b82-81ef-68bfbfce76e8 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:13.815107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 217/438] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:13.822856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:13.823922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:13.824527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:13.843501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:13.845074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:13.908262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 222/439] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:13.929773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc292c-cfbe-4b82-81ef-68bfbfce76e8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:13.943633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc292c-cfbe-4b82-81ef-68bfbfce76e8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:13.948352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:13.949557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:13.950032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:13.950494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:13.962139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:13.969477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:13.976278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 218/440] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:13.977893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:13.987648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c170-fb7a-4826-8943-b7ce2d33625e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:13.992483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:13.993402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:13.993878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:13.994388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:13.995387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:13.995885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:13.997762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.007186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 223/441] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.013827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.024743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac681b-1cca-4729-94e4-1b7ca6b5455d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.029785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.030706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.031226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.031705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.040335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.042467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.058307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 219/442] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:14.060024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.070394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e019d-e9bf-44c4-a446-c95d55a762b4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.079591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.080831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.081359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.081826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.083232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.085511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028fe38-19af-453d-8cdc-c3f57a754493 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.087490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 224/443] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.098141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.108126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bfb3c-d7e9-4795-b3f1-1c5e4986fab2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.116032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.117176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.117669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.118154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.121338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ffdd-5d51-456e-8050-d2296c51f3a2 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.121984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ffdd-5d51-456e-8050-d2296c51f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.122478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ffdd-5d51-456e-8050-d2296c51f3a2 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.126731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 225/444] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:14.128222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.130415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.132734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.135188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.135671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.138448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 220/445] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.164408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.172613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:14.175403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:14.177672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b98b-c874-4632-a6a2-a769d81a2068 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.187369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.189112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.190205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.191121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.193679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=574d09a8a9f84702aebd0649fb13013a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:14.194332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.198227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f4689-2c76-4b08-b00e-182dd941537b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.199471 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 226/446] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:14.207203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 221/447] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=7a34713434094c19b43446fca1e27cf7 => generated 611 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:14.251518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.260644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0174-3569-483c-bbdf-9c4999fb097c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.260990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0174-3569-483c-bbdf-9c4999fb097c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.261434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0174-3569-483c-bbdf-9c4999fb097c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.262228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10327bf6-ecb0-4123-ad97-83dc3d0a9a20 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.264916 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 222/448] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:14.269932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.270224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.270505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.271743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.272894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.273401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.273867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.289579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:14.297845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:14.299907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:14.303004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:14.303004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:14.310798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.318203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 223/450] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:14.323379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867930d-6c6e-4faa-a6f6-de4208374111 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.328416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.329407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.329984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.330476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.331552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:14.332235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.334251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.347185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.348687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 228/451] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:14.359903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.366604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68cd1-e608-4027-8578-4be5cb4768c7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.372177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983c0be-6cdd-409c-8e42-ce15f3ea3c51 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.378055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.379188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.379670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.380239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.381993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.382832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.383128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.383403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.391231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.393860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.407400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 229/452] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:14.414363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:14.421547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 25 04:36:14.423043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 224/453] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:14.431251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.431440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.442114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356ef0c-e6f3-4b63-a70f-997aa6f6d943 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.448961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718af6-21ac-4537-9369-5fef34a3051d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.450314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.451450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.451964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.452528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.454007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.456461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.456571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.457189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.457471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.457743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.458518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:14.458822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.460061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 230/454] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.460452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.469029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.480026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 225/455] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.481263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cb7b-fc72-4c3a-8b19-8945950996d0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.486201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.486447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.487549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.488056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.488551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.489998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.492544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.494531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 231/456] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:14.503730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.506166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b844a07-736d-446c-817c-b8cb46bca2e7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.516511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.517188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.517471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.517760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.527232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.527607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de1559-df4e-4c88-9c2b-2f8de60f2e8c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.529155 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.540004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:14.546942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.552868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.553751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.554043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.554320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.555205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:14.555519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.556459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c5a2-4751-4f41-9bf3-5e7a5b59e2df admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.557423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.566264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 232/458] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 611 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.569723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.570636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.570926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.571203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.572620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.574898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.577164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 227/459] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:14.583110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.594237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4238f1a-e15d-4e1e-890f-b50a90f76142 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.599389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.600457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.600746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.601026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.602633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.604760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e489df7-377f-4e47-930a-153a3872daaa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.607228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 233/460] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:14.614165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:14.626312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea2e26-11bc-4b84-8570-1da314627f85 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:14.631140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:14.631831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:14.632112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:14.632449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:14.633414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=7a34713434094c19b43446fca1e27cf7, scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:14.633729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:14.635663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d8ead-191c-47f9-8c74-220a108e976d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:14.643133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 228/461] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:14 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=1bfccf3a4b984f68b07f792b4eda21aa&role.id=7a34713434094c19b43446fca1e27cf7 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:15.702288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592084fa-a97e-4afe-90ab-c66ea1716613 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.702937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592084fa-a97e-4afe-90ab-c66ea1716613 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.702937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592084fa-a97e-4afe-90ab-c66ea1716613 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.705108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 234/462] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:15.711145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.711636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.711636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.729717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:15.731058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:15.739199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 229/463] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:15.764434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592084fa-a97e-4afe-90ab-c66ea1716613 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.777694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592084fa-a97e-4afe-90ab-c66ea1716613 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.782330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.783187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.783467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.783737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.794157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:15.801342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:15.802558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 235/464] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:15.809391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.818338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58534f-49c1-42c3-86dc-8e1cacbcca3f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.822745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.823377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.823660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.823934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.824742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:15.825047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:15.826644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:15.834751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 230/465] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:15.840953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.851023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723bdca-70a6-4734-816c-e111a4fcb703 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.855425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.856050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.856379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.856650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.864319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:15.866029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:15.875043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 236/466] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:15.880785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.890802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161e96-ae7e-4ac1-b60a-7108f5368265 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.895480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.896438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.896728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.897032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] PATH_INFO: `/v3/projects/574d09a8a9f84702aebd0649fb13013a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.898329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] RBAC: Authorizing `identity:get_project(project_id=574d09a8a9f84702aebd0649fb13013a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:15.900451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53548bd-3e18-449b-989a-8d2f229a7cad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:15.902196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 231/467] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/projects/574d09a8a9f84702aebd0649fb13013a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:15.908076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.916891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d247c-4d25-471c-a899-d2904e919494 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.921799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.922633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.922911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.923183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] PATH_INFO: `/v3/groups/d9106d6b59824569963ac622bf9438e8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.924423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] RBAC: Authorizing `identity:get_group(group_id=d9106d6b59824569963ac622bf9438e8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:15.926279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:15.927832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 237/468] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/groups/d9106d6b59824569963ac622bf9438e8 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:15.930729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2c9-e27a-4f2c-bb96-c06e50feb91f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.931132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2c9-e27a-4f2c-bb96-c06e50feb91f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.931456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2c9-e27a-4f2c-bb96-c06e50feb91f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.933489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 232/469] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:15.933724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:15.939169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.939461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.939733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.943441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96677072-6cbd-452c-9486-c37a84fbee83 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:15.947925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:15.948706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:15.949107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:15.949471 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:15.950319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] RBAC: Adding query filter params (group.id=d9106d6b59824569963ac622bf9438e8, role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=574d09a8a9f84702aebd0649fb13013a) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:15.950630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:15.952466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:15.957502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:15.958642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 238/470] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/role_assignments?group.id=d9106d6b59824569963ac622bf9438e8&scope.project.id=574d09a8a9f84702aebd0649fb13013a&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:15.958736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:15.967156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 233/471] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:15.992081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.003454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832827d7-d61b-4feb-8c29-00a7244e7eda admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.008838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.009661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.009945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.010217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.023410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:16.030563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:16.031870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 239/472] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:16.038977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.049008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf6465-cdf2-4260-ac0d-91b7caf73771 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.053958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.054633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.054915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.055185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.055967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:16.056305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:16.058051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:16.067690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 234/473] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:16.074358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.084524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123d50b-72a5-48b7-acf6-bec61c145e6c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.089653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.090332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.090612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.090888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.100739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:16.102516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:16.112551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 240/474] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:16.119315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.130468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8653adf-c994-4954-b984-61f9d9d28e5a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.135380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.136360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.136665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.137011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] PATH_INFO: `/v3/projects/eecafb0e45fb4de69b43e46178412ed9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.138357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] RBAC: Authorizing `identity:get_project(project_id=eecafb0e45fb4de69b43e46178412ed9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:16.140192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:16.141951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 235/475] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:36:16 2021] GET /identity/v3/projects/eecafb0e45fb4de69b43e46178412ed9 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:16.148497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.158102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374a14-cb87-4b8e-b86a-7fed1ca52e8f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.162525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.163365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.163649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.163924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] PATH_INFO: `/v3/groups/5f992ddc40f3481988f3b25408c00127` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.165148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] RBAC: Authorizing `identity:get_group(group_id=5f992ddc40f3481988f3b25408c00127)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:16.167030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60988cff-a972-4135-9da1-e7b6ac1fcca2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:16.169190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 241/476] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Nov 25 04:36:16 2021] GET /identity/v3/groups/5f992ddc40f3481988f3b25408c00127 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:16.175663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:16.185967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5543698-dd1d-4f29-b5c5-26627f570078 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:16.190610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:16.191255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:16.191541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:16.191814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:16.192689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] RBAC: Adding query filter params (group.id=5f992ddc40f3481988f3b25408c00127, role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=eecafb0e45fb4de69b43e46178412ed9) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:16.193032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:16.194873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e59c0d-192e-4964-9362-b04f85d1232d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:16.201556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 236/477] 10.222.0.36 () {56 vars in 1397 bytes} [Thu Nov 25 04:36:16 2021] GET /identity/v3/role_assignments?group.id=5f992ddc40f3481988f3b25408c00127&scope.project.id=eecafb0e45fb4de69b43e46178412ed9&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:19.214979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1f19-33c8-4d1a-8042-a1a92facb9ee None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.215511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1f19-33c8-4d1a-8042-a1a92facb9ee None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.215587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1f19-33c8-4d1a-8042-a1a92facb9ee None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.217983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 242/478] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:19.224113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3d43-3ca2-4e56-ae22-ade4dfdbf741 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.224660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3d43-3ca2-4e56-ae22-ade4dfdbf741 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.224741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3d43-3ca2-4e56-ae22-ade4dfdbf741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.253437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-129e3d43-3ca2-4e56-ae22-ade4dfdbf741 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:19.254702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-129e3d43-3ca2-4e56-ae22-ade4dfdbf741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:19.260735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225ffd3-124c-477f-8467-fea240ca711c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.261113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225ffd3-124c-477f-8467-fea240ca711c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.261944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225ffd3-124c-477f-8467-fea240ca711c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.263480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 237/479] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:19.263943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 243/480] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:19.269956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.270250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.270527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.290292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225ffd3-124c-477f-8467-fea240ca711c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.295408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:19.296652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:19.312381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225ffd3-124c-477f-8467-fea240ca711c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.318006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 238/481] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:19.331284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.332108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.332423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.332697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.345024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.346886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.353483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.363532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7af37-115a-479a-9334-4e297182b57a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.375470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.376580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.377063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.377526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.388718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-cd6c7216-f159-49b5-a2d3-3cec43ceb0be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:19.394954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 244/482] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:19.402486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5832-1d90-4447-9bd1-59e591e92e55 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.402760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5832-1d90-4447-9bd1-59e591e92e55 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.403040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5832-1d90-4447-9bd1-59e591e92e55 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.404362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.405187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 245/483] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:19.405896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5832-1d90-4447-9bd1-59e591e92e55 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.406815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.427389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5832-1d90-4447-9bd1-59e591e92e55 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.432121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.433161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.433638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.434120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.435070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:19.435573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.436811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:19.436811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:19.436811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:19.437024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-4fcbeac4-adc7-4c2d-8ba7-795674f4a89e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:19.438223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.439077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 239/484] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:19.441006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.441496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.441974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.458180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 246/485] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:19.464275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.472878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:19.474457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534bfb-06e2-4500-bde3-756b05304345 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.474840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:19.479198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.480111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.480618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.481097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.482029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:19.482504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.484289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.488037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 240/486] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:19.496719 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 247/487] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:19.498061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.503715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.513364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e3447-6665-4a37-87ea-f368316bd67b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.523686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2dfe1-ea99-4d77-9cd8-8925a06849a3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.526041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.526845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.527129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.527406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.528203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.530085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.532521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.533933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.534760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.535462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.537040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.540952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab6686-4c4f-4b37-b750-c29682aef565 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.569112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 248/488] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/users => generated 246 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:19.569625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.591686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 241/489] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/users => generated 248 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:19.594712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab91d5-4465-4dee-a649-9998f20f6d50 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.602625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.604890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.605702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.606635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.632047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.636626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.666836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:19.669351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe40fbe-e16e-42d9-9467-6e93815474a6 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.669500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 249/490] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:19.669993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe40fbe-e16e-42d9-9467-6e93815474a6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.670508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe40fbe-e16e-42d9-9467-6e93815474a6 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.672873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 242/491] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:19.680242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.686255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.687186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.687661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.689225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f9fb3-3af3-4198-9eed-043c42bb6e6d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.694116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.694826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.695104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.695369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.696210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:19.696523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.698214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.709709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:19.712055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:19.728438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 243/492] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:19.729104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 250/493] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:19.733349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.743691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98bf4a-9d84-441c-bdb5-ff140f95c14a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.749288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.750366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.750876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.751340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.752346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.754569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.771769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.788286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f47cb-9442-4a7e-b2b6-0a7af3773f62 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.794411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 244/494] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:19.797862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.798952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.799474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.799977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.812873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.815527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.838991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:19.842138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 251/495] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:19.848461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.862669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc74a2-30d1-4797-aa3b-a8a9a8c70446 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.871002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.872094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.872558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.873015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.874277 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:19.874747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.876735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a339b-c93c-459e-a398-84323de1ec8b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.892214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 245/496] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:19.898365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:19.911800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df270-5ab4-4837-ba10-f991a278cc36 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:19.922801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:19.923795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:19.924356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:19.924791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:19.925749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:19.928055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd07ad4-0af0-48c8-a4bd-2738285f34e0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:19.955906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 252/497] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:19 2021] POST /identity/v3/users => generated 249 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:20.779743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6e51-1c04-4052-870d-7b75c7439e55 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:20.780616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6e51-1c04-4052-870d-7b75c7439e55 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:20.781034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6e51-1c04-4052-870d-7b75c7439e55 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:20.783263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 246/498] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:20.790284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:20.791057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:20.791474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:20.817108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:20.818525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:20.826621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 253/499] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:20.862063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6e51-1c04-4052-870d-7b75c7439e55 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:20.881757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6e51-1c04-4052-870d-7b75c7439e55 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:20.887154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:20.887984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:20.888493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:20.888927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:20.889840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:20.891563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:20.902811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.sql.core [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 25 04:36:20.902811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 25 04:36:20.902811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [parameters: {'id': 'e7d15035d9164f1c85db9f0b218135d9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 25 04:36:20.902811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 25 04:36:20.918257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 25 04:36:20.920135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 247/500] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:36:20 2021] POST /identity/v3/roles => generated 144 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:20.926212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:20.936184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad4c20-2780-4a46-95de-8bec8ff99821 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:20.944000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:20.945005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:20.945425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:20.945833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:20.961561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:20.969405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-3e020be2-e0cc-48ca-bea1-a529f195742f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 25 04:36:20.970767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 254/501] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:20.977179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:20.987464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ed7da-f09f-4aed-8525-42562bbc3123 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:20.996248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:20.997113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:20.997549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:20.997963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:20.999182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:20.999640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:21.001530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf44b91-c6b3-4bc3-945c-49a8ff3f4b01 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:21.012997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 248/502] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:22.560361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc736bd-efc6-416e-8471-6c54295c8fbd None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.561216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc736bd-efc6-416e-8471-6c54295c8fbd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.561666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc736bd-efc6-416e-8471-6c54295c8fbd None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.563805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 255/503] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:22.575379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.581187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.581661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.608269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:22.609714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:22.624014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 249/504] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:22.654651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc736bd-efc6-416e-8471-6c54295c8fbd None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.671105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc736bd-efc6-416e-8471-6c54295c8fbd None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.679652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.680553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.680833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.681109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.696047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:22.703011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-12153cc8-a837-44ca-a1bc-99271dbba7a8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:22.704548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 256/505] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:22.710691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.728175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10967a46-240c-4215-bb66-b14edc50b595 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.735194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.736088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.736548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.736966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.737885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:22.738351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.740095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:22.744325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968cc7-d00d-4df0-9142-3283e08307b2 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.744616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968cc7-d00d-4df0-9142-3283e08307b2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.744893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c968cc7-d00d-4df0-9142-3283e08307b2 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.747315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 257/506] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:22.751334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 250/507] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:22.756212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.756212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.756212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.757766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.768259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20879c60-ebb3-4a12-a42b-d78670bba4bf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.781815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.782783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:22.783207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.783796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.784012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:22.784492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.798321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 258/508] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:22.806625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.808632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:22.822513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.831911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11ac05-15a7-467f-8b8d-9ed6272652ae None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.840579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:22.844628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 251/509] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:22.851012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.854433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.855406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.855681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.855950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.875295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f165d-eee2-4a4a-b3bb-813eaa0c1ca3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.879658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:22.887281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-a64e140e-ccc3-4d14-8a5c-6b99f571fa8c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:22.888741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 259/510] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:22.890749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6f48e-9a90-4681-820f-be6e9c7f5c66 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.891234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6f48e-9a90-4681-820f-be6e9c7f5c66 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.891727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6f48e-9a90-4681-820f-be6e9c7f5c66 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.893615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 260/511] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:22.895322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.896258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.896748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.897217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.898151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:22.898663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.900310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa8e40-a12f-40da-ab32-6679f719b5a4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:22.901166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6f48e-9a90-4681-820f-be6e9c7f5c66 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.915295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 252/512] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:22.916414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.916698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.917028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.918007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6f48e-9a90-4681-820f-be6e9c7f5c66 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.923895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.924599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.924885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.925163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.926557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:22.926557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.927829 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:22.937616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:22.938327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 261/513] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:22.939137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.939609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:22.949322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 253/514] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:22.949561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515940b-81d5-4e27-bed3-db0939e96526 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.950542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.953902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.954692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.954973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.955243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.963186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.964838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427c73d-afe9-40bd-b8a5-a1ccd3b976a3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:22.965721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:22.971735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:22.972815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.973294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.973777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.981174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-ad1742d0-7be8-4093-bd99-4a77864dd9cb admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 25 04:36:22.982375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 262/515] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:22.983625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac366d4-2ec1-4369-be2d-19360138eac0 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:22.983918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac366d4-2ec1-4369-be2d-19360138eac0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:22.984211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac366d4-2ec1-4369-be2d-19360138eac0 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:22.986122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 263/516] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:22.986247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:22.986820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac366d4-2ec1-4369-be2d-19360138eac0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:22.988581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.000962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac366d4-2ec1-4369-be2d-19360138eac0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.005261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.006043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.006325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.006595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.007009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-ef350756-d0b5-45b5-a5fc-3cb723e2fdd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.009385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 254/517] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.009385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.009681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.009955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.022408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:23.030253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:23.030572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:23.031620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 264/518] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.032234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.032837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:23.043089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 255/519] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:23.044404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.045906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6486128-4c2a-46a4-87dd-abc7a8ca0057 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.055917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.056858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.057220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.057584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.059009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.059403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.060676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:23.060676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:23.060676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:23.062014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.063408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b964a-1a35-41f7-9943-981c88a6a6b0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.069431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.070439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.070931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.071411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.072330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.072578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.074419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.087017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 256/520] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.087822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.097028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec91a0-4427-4b80-a881-6ca3b2016711 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.101384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.101850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 265/521] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.102031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.102316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.102594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.102676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.103415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.103731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.105493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.113040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d847-74fb-43cc-9be6-61d9c9f9321e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.113708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 257/522] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.114477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.117800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.118612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.118898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.119170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.124590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52d74-90bd-4005-bf88-c8837cd62b7c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.128898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.129658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.129878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:23.129975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.130201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.136721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:23.138044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 266/523] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.138146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.138650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.139998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.147676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401438c-770f-4a9d-aa8a-1acca8c07aa6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.152207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.152749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.153031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.153304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.153399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 25 04:36:23.159579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 258/524] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users/cinder => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.159579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.161998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.163759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.168687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de095e-c531-45f8-b435-2ed811e09526 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.177850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 267/525] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:23.177968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.178094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.178181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.178181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.178181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.182195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cf488-1b71-41c8-83f8-a97dba344145 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.188763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.189393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.189670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.189938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.190025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.190683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.190986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.192095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.192594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.205721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 268/526] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.206443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.210051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.216449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 259/527] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.216449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.222337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ba4b6-4490-43b1-b0d5-2a1bf9abed13 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.225970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a9793-9ba6-4601-94c2-bdd45ce18589 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.228573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.229326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.229666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.229922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.230981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.231289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.232037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.232888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.233176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.233453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.235152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.245442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.247354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.258039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 269/528] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.258039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.263546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0346-d8e1-46c6-ad4f-82a83fcf7ecb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.267960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.268819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.269103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.269417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.269511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.275697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 260/529] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.275697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.281438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38011857-5ff0-4cd1-9e48-d38587ff8673 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.285751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.285888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.286490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.286774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.287052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.287716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.287810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.288077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.289797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.302868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 261/530] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.303949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.305690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.306993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 270/531] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.307679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.315046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6075f4-5816-4ff9-913e-4a4eb41134c1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.316872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037c54-56c3-45e0-8ae5-15ae37aa9efa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.319737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.320493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.320846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.321181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.321517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.322219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.322565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.322961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.323961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.324337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.325992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.329868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.331690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.337939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 271/532] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.338612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.345777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 262/533] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:23.347434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.352384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be02afb-27fe-4f22-bfe5-4236e285fd4f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.357266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.358179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.358524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.358624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d162cc-eae6-4783-96c2-3a85c873beed admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.358903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.363582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.364274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.364554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.364824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.365557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.365860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.367387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.367493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.369529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.385317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 263/534] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.385317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.385587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:23.385587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 272/535] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.385587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.394873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c3ce5-3dbf-4973-9e34-874f7192a3a7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.398812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c854-bee5-406e-8d5b-36576e960ee8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.399253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.400047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.400421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.400758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.404208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.405059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.405429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.405761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.412460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.412875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.414407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.414875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.428136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:23.437104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 264/536] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.437104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.437318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.437318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 273/537] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.437318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.446513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1683-1dcf-45f6-9d45-30412f01b611 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.447626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53be96d-5239-433c-ae27-5a4e2a4af0ee admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.451025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.451763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.452116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.452481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.453236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.453477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.453853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.454205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.454565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.454902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.455976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.462903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.465266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.478892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 274/538] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.478892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.480511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 25 04:36:23.481903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 265/539] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.486806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.488773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698b61b-eab5-4f38-bf6e-7cb37be9b1e7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.493605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.494365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.494748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.495247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.496330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.496442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116add5-ff8e-4a8c-bc53-553c40c4df1d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.496812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.497904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:23.497904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:23.497904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:23.499672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.501213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.502116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.502486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.502809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.503613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.504187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.505706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.522337 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 266/540] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.522508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 275/541] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.522588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.525833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.531734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d42a3-7e2b-4fc6-a4d7-1ecc182dc7ac admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.536393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.537041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.537321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.537489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eafa8-99c5-46c9-a4fc-fc61c86af4ff admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.537650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.541815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.542647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.543030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.543315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.544194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.544508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.545864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.546346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.547594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.556211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 267/542] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:23.561394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.567355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 276/543] 10.222.0.36 () {56 vars in 1160 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.567355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.576304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccc53c-99d8-4658-baa6-8c54cd6771bb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.576911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37557bcd-c1af-41e6-9f84-ea04030ed97e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.581495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.582159 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.582443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.582684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.582806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.583549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=c7db691378f74f4f8792b779ca0181f1) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.583862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.584005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.584477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.584891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.585737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.591348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 277/544] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/role_assignments?user.id=c7db691378f74f4f8792b779ca0181f1&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.591348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.594836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.596963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.613036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5133-9991-4ea4-938c-5c7c673eb1db admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.616481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:23.618025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 268/545] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.618781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.618910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.619993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.620625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.621146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.630090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9032ac-fa70-4062-b1aa-30bd626862ba admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.635115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.636183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.636996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.637344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.637687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.638193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.647992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.650393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.660661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.660892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 269/546] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:23.661861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.662769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 278/547] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.672184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.678826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953ee6-6a14-4212-ba71-7e689824d693 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.682681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630866c2-f543-4d38-bb8f-27eb58da2708 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.683986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.684888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.685318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.685688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.687047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.687368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.687766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.688452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:23.688452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:23.688452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:23.688688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.688922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.689264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.689745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.690161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.690553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.692341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.706179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 279/548] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.707177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.715815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 270/549] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.716817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.726868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fbcc5-e96e-496e-b965-39971f15cd4a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.731742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97172f2d-265d-4e8c-bb2e-0a6a436ae7b7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.732647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.733668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.734046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.734394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.736826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.737828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.738235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.738574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.746849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.749212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.749516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.751326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.764165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:23.765952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 271/550] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.766826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.773370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:23.774808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 280/551] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:23.775672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.787443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6e34f-1022-428d-b9db-7b57df959977 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.790474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb42835-89cd-4e09-af2f-f67b89bef83b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.792688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.793454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.793822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.794197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.795269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=140bf1d478d74252a94ab359064731dd) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.795560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.795727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.796452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.796843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.797181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.797505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.798112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.798484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.800546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.810073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 272/552] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/role_assignments?user.id=140bf1d478d74252a94ab359064731dd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.811081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.815376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 281/553] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.822271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b14471-485a-419c-ba2c-2f1ee481db7e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.827186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.827798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.828083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.828203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.828385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.829243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.829558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.831314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.848258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0b42-f4e7-4ac6-b176-a605373b070b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.848533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 273/554] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.858197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.858655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.859445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.859834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.860120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.861026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.861341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.863229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.870659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 282/555] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:23.870861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6d07-246b-4b5e-89be-83801b3269df admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.878873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.879192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.879474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.879746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.892372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.894471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.910242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:23.911728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 274/556] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:23.918104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.936406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde0fd-1c75-457c-a86b-8404e05d4a56 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:23.944622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:23.945324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:23.945613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:23.945888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:23.946713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:23.947022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:23.949126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014955-26e0-4236-b17b-3398f99cb0d4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:23.963071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 283/557] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:23.970048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:23.985895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e839a-dc95-4686-a844-261d088a5d04 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:24.001107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:24.001795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.002077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.002354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.003234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=7f881943403942878b4ac80e11c2f5a6) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:24.003541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:24.005468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad96a4-a6f7-43e5-9359-4337cd941049 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:24.012217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 275/558] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:23 2021] GET /identity/v3/role_assignments?user.id=7f881943403942878b4ac80e11c2f5a6&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:24.130144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc1dc-db86-481c-b76c-c5671ccd1738 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.130504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc1dc-db86-481c-b76c-c5671ccd1738 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.130897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc1dc-db86-481c-b76c-c5671ccd1738 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.133204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 284/559] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:24.141810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d43470-058b-4973-974f-653116772af6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.142371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d43470-058b-4973-974f-653116772af6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.142790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d43470-058b-4973-974f-653116772af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.168633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-51d43470-058b-4973-974f-653116772af6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:24.170080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-51d43470-058b-4973-974f-653116772af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:24.178508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 276/560] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:24.217406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc1dc-db86-481c-b76c-c5671ccd1738 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:24.233942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc1dc-db86-481c-b76c-c5671ccd1738 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:24.238779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:24.239841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.240326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.240753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.256263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:24.258388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:24.276312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:24.278241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 285/561] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:24.289573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d43470-058b-4973-974f-653116772af6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:24.299322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d43470-058b-4973-974f-653116772af6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:24.305444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:24.306134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.306468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.306751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.307529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:24.307845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:24.309528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228077-6bb3-4a28-8e38-d1a45a516832 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:24.325561 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 277/562] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:24.331566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:24.341957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d4ce-ecaf-4f46-bc3d-4dca5100ed3a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:24.346657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:24.347349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:24.347632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:24.347908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:24.348746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:24.350710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479bb3-4ceb-4ffe-b249-a5555c3ebb00 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:24.374532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 286/563] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:24 2021] POST /identity/v3/users => generated 247 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:26.537153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e06e2-d166-46fc-abd7-cfe2b4d8688c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.537902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e06e2-d166-46fc-abd7-cfe2b4d8688c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.537902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e06e2-d166-46fc-abd7-cfe2b4d8688c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.539809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 278/564] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:26.545972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.546477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.546624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.565594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:26.567126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:26.579008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 287/565] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:26.602463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e06e2-d166-46fc-abd7-cfe2b4d8688c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.615471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e06e2-d166-46fc-abd7-cfe2b4d8688c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.619888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.620819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.621103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.621376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.640832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:26.647692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:26.649388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 279/566] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:26.655683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.668928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d538f2-87e9-48ce-a7db-c71984236815 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.676751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.677419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.677696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.677967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.678736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:26.679035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.680657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.689707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 288/567] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:26.696207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.713291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0b45-2a40-47a8-b99f-83999cd7b89b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.723055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.723851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.724132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.724426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.735334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.737244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.753920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-65879645-5fb8-491f-9dbe-320e461f731c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:26.755466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 280/568] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:26.761767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.771409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87978-067b-48c6-ab3d-d36592eb4521 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.771994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87978-067b-48c6-ab3d-d36592eb4521 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.772505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba87978-067b-48c6-ab3d-d36592eb4521 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.774807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 281/569] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:26.778447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5498c2c-db05-49a9-be83-6ed623f6e414 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.778947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c33b9-644c-4bbc-9372-047c858a0bfe None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.779226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c33b9-644c-4bbc-9372-047c858a0bfe None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.779502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c33b9-644c-4bbc-9372-047c858a0bfe None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.781571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 282/570] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:26.782604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.782885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.783154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.786672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.787661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.788175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.788665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.789892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:26.791296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.793215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661c196-73b1-4f31-a710-969d48d28bb0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.804539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:26.805981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:26.807576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 289/571] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:26.812256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.812256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.812256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.819752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 283/572] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:26.820776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.829508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:26.830213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39fbdc-c078-4f46-9f75-aec51ff9d292 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.831023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:26.835453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.836382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.836758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.837221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.839959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 290/573] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:26.845408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.847532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.850027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.859893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5417d6e-2285-4449-bcac-2c84b721e3ee None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.862522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 25 04:36:26.868173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 284/574] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:26.868805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.869687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.869861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.870274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.871544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.885032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2ccd8-7542-4ee8-834c-a863e422b41c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.885692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:26.889761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.890461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.890746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.891018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.891874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:26.892196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.893209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:26.893209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:26.893209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:26.894330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.894878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:26.896299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 291/575] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:26.901096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.912659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbaef5-47cb-459a-a927-c6ca620f20bc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.917489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.918529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.918999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.919458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.930625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:26.940403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 285/576] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:26.940403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.940640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:26.941207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 292/577] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:26.942504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.954579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37045002-17e9-4bd4-8d51-477a94c626d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.955675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02c4c2-2c62-4784-913e-bf3fe633c964 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.959029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.959836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.960110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.960438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.961881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:26.962759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:26.963239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:26.963791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:26.964789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:26.965285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.967104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.972981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:26.975262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:26.981737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 286/578] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:26.982925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:26.992747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50a33-fdcc-4c72-8441-79ac85dea9f3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:26.993996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.000549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 293/579] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.000549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.003147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.003815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.004094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.004397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.008510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.009020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.011014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.014789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31447-2bb3-4f0e-a4e1-5e6e3812f4d2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.020055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.020868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.021149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.021419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.022253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 287/580] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.023354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.033924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ea5f6-bb59-4387-9f0a-c7dcb338a4fd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.038833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.039408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.039949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.040458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.040922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.041317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.042267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.042762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.044608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.061157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 288/581] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.061330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-d193a2bd-f2d4-4c88-8fff-d9c0efc4120a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.061429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.061501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 294/582] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.061501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d30f-137c-4dcb-a173-6df53e1d87cd None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.061636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d30f-137c-4dcb-a173-6df53e1d87cd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.061983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d30f-137c-4dcb-a173-6df53e1d87cd None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.063808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 295/583] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:27.064750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d30f-137c-4dcb-a173-6df53e1d87cd None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.075211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c5841-ad42-45ba-b16b-40ed7ee4fd19 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.077047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d30f-137c-4dcb-a173-6df53e1d87cd None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.080528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.081354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.081803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.082135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.082418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.082676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.082774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.083221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.090312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.092301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.095233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.097323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.105186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-ed9aab0f-284f-4281-ada3-8f6c4b7db029 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:27.106399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 296/584] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.107588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.107868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.108139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.121246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.123764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 289/585] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.124999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.129231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:27.130557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:27.138877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 297/586] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:27.139303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c65f5d-429a-42d5-9ee0-215c44ee8e81 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.139478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.149146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.150006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.150160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dae85-c46b-4c73-9577-d823120ec89c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.150591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.151088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.152279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.152728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.154679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.155067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.155714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.156083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.156411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.157305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.157660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.159603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.170100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 290/587] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.171644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.172946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 298/588] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.173675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.183520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32540fad-c962-4ae6-ad53-ae9d83c5b0a1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.184501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9262524-f9e2-4eba-aae6-b8ee942768d7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.188803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.189530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.189785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.189945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.190050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.190842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.190977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.191154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.191245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.191397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.192814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.204416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:27.212104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 291/589] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.212104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.212407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:27.214856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 299/590] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.214856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.222500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59d000-7fd9-489b-a5f0-1c68acbc5f8c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.224099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d9dec-d449-4811-b732-47bcd4a14d24 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.226887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.227674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.227958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.228268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.229130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.230237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.230339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.230602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/c7db691378f74f4f8792b779ca0181f1/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.236373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.238414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.245085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=c7db691378f74f4f8792b779ca0181f1, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.247856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.252517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:27.258598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 292/591] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.258598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.264503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc660d-f56a-4881-ba5d-69d147835ca5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.272247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 300/592] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:27 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/c7db691378f74f4f8792b779ca0181f1/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:27.272247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.332051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.333322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.333753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.334217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.346651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.349085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.356137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09e4b2-7f7b-494c-8514-936e7a48f59a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.361255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.361950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.362232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.362508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.363287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.363593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.365320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.366660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 25 04:36:27.368433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 293/593] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.369429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.376023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 301/594] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.377577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.380197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a1bf-b6f0-4d4f-bdd2-bde05232d297 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.385101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.386073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.386449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.386868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.387917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.388138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c51002-4bd9-414f-b07f-3c23671588eb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.388447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.391108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.392918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.393881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.394166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.394548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.396378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.396694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.398641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.413398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 294/595] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.414436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.421961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 302/596] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.423155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.425197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8275fd-36f4-458d-81ae-7d347fa1b2d3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.429955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.430962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.431347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.431716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.433186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e26753-f48f-449c-9e17-c2e5a34df29a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.438493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.439325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.439610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.439886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.445515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.447698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.453390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.455663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.472731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.474319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 295/597] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.475103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.475575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.476898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 303/598] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.482019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.487815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c4436-eff8-432b-8a48-3fd4774dde45 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.494129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acdb0b-f90f-4cda-9a51-7334312c4283 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.494617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.495956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.496365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.496648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.499372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.500050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.500362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.500637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.501443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.501748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.503409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.509991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.512815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.516665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 304/599] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.517524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.527127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79901160-d6d4-4685-82a4-912e6879d85d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.531640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.532346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.532627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.532902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.533840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.534097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.534257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.535707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 296/600] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.535879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.536711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.549141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 305/601] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.549818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.552569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d0e2d-4e7e-4613-a61f-fb965e192bd7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.560383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.561303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.561535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.561813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.569113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd4147-9568-42f8-832a-b79bfb1f0319 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.569950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.570118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.571911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.571911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.572265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.572408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.572408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.574575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.574928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.589869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 306/602] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.591016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.591278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-643c623b-d1d6-4e5a-bfe7-7a5ded5daa04 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 25 04:36:27.593111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 297/603] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.594413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d71f1-0acf-4e3f-b609-4fab0274070c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.594692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d71f1-0acf-4e3f-b609-4fab0274070c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.594970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d71f1-0acf-4e3f-b609-4fab0274070c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.600424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 298/604] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:27.600424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d71f1-0acf-4e3f-b609-4fab0274070c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.608624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc2c2-b09a-48fa-8fc2-2c5a98c31857 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.613859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.614804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.614960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d71f1-0acf-4e3f-b609-4fab0274070c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.615218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.615894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.623565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.623708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.624491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.624771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.625041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.625579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.633136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.635073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.638933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:27.640423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 307/605] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.645524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.648219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-99810712-5c73-4aaf-8c86-d1fea066a882 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:27.649532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 299/606] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.650785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.651684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.652055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.654727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e7ce5-517c-443c-8f21-1a52ef840e23 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.659219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.659871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.660211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.660489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.661330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.661631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.663432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.671928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:27.673803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:27.684204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 308/607] 10.222.0.36 () {56 vars in 1160 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.684204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.684412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 300/608] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:27.686282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.694165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b9a44-1bd1-4b7a-a9d7-6b5d2d83146e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.698789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.699461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.699735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.700000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.700837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.701141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.701735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acede9a3-8008-43be-aef4-45dbf3b54840 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.703042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.707582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.708494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.708948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.709396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.710886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.711400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.714258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.715605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 309/609] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.716435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.726003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49000e8b-f572-4d41-b86c-7a76feb08809 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.728677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 301/610] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.729656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.731750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.732730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.733189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.733758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.739982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f10e5e-08ef-495a-92e4-573bca5c3126 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.744587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.745037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.745578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.746058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.746282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.746858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.756745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:27.763539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:27.763728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:27.764949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 310/611] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.766507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.769754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 302/612] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:27.770507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.777140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8927c6-a4c5-4cf8-bb18-de0b5c51e9c9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.780880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afab4d-f3f0-41ac-b827-d5ce087282dc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.781477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.782351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.782630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.782898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.786328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.787191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.787473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.787749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/140bf1d478d74252a94ab359064731dd/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.798287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=2a5832639148459ca8895ae9e26e4b1a, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.801037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.802077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=140bf1d478d74252a94ab359064731dd, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.804725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.814815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 311/613] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:27 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:27.818402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 303/614] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:27 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/140bf1d478d74252a94ab359064731dd/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:27.819610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.825261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.949173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dec4a3-b1a5-47e7-859d-9e0223c0371d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.954390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.955513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.956010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.956532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.957563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.958083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.959998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.966876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa2b3c-4a42-477a-9a35-8e7c1d5ed549 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:27.970832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 304/615] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:27.978019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:27.978360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:27.982563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:27.999317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019e16-0262-46e7-ac9c-b98af3e6f9aa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.012743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 312/616] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:28.015954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.016859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.017145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.017488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.020675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.043049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a6aa-bfd0-42d0-9d45-b12674f0e054 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.045215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.048985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.061945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.063195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.063707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.064203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.075109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.077488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.080024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:28.081738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 305/617] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:28.093515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.095346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:28.097366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 313/618] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:28.105040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.107338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e33f8d-a636-499e-b8be-999cef66aa00 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.116642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.117329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.117614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.117869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38086c49-9158-40fc-a06b-6209f3769ed7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.117993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.118631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.118937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.120810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.127926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.129080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.129365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.129632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.130499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.130801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.132782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.135432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 306/619] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:28.142510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.145834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 314/620] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:28.151935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.154065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44b18b-571b-46d3-8c90-0b34f0978ade admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.159266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.160915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.161474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.162166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.164609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06998-7a03-455c-9180-136622bfd66c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.169202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.170154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.170435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.170705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/7f881943403942878b4ac80e11c2f5a6/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.176002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.178354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.188846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=7f881943403942878b4ac80e11c2f5a6, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.191532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.195756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:28.197748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 307/621] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:28.207317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.209933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 315/622] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:28 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/7f881943403942878b4ac80e11c2f5a6/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:36:28.219306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14e026-a903-4fc0-b79c-b8b31b1de4e6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.301057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.301761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.302044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.302317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.303190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.303495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.305401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.327883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 308/623] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:28.334053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.349800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87392007-dae2-4ca4-9cff-af3f63f3a9c9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.357725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.358383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.358660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.358930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.372505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.374586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.386217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 316/624] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:28.392430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.405498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f303e3d-c02b-4ee5-9dc1-8b420c149e5d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.415981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.416879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.417317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.417607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.434884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.436781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.459702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:28.461248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 309/625] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:28.467480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.484226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54811-c4b8-4255-9f9c-2d4c664fe5a5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.496660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.497423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.497708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.497982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.499072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.499432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.501104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.524673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 317/626] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:28.531015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.545478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff561-ad48-4704-954d-5d6ca8167b49 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.552411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.553208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.553739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.553739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.582402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.584439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.602256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:28.603724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 310/627] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:28.609929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.626808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e54c-e5dc-4bce-9498-b4a0579261fe admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.639093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.640198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.640688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.641166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.642181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.642731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.644859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00ebd-4a24-48a7-9b30-101703c79d7f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.658767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 318/628] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:28.664886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:28.677642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a614a-bc37-42f0-8dcb-d36e041b835a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:28.682608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:28.683601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:28.684087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:28.684590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:28.685635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:28.686166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:28.688269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2a231-3b74-490e-bc78-a2e453bc9476 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:28.694779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 311/629] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:28 2021] GET /identity/v3/role_assignments?user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:29.948003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409cdc2-a057-4bd5-8459-5ebf38d85f71 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:29.949055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409cdc2-a057-4bd5-8459-5ebf38d85f71 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:29.949539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409cdc2-a057-4bd5-8459-5ebf38d85f71 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:29.951806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 319/630] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:29.958477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:29.958910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:29.959018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:29.985201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:29.986427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:29.994405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 312/631] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:30.027928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409cdc2-a057-4bd5-8459-5ebf38d85f71 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.049371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409cdc2-a057-4bd5-8459-5ebf38d85f71 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.053852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.054674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.054956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.055227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.077257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:30.084286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:30.085867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 320/632] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.092839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.105680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6380-500b-490f-835a-99d82bed4e6f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.115042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.115725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.116001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.116295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.117106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.117401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.119013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.132388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 313/633] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.138727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.152482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e09d-de83-427d-9a62-44e99cc79fba admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.159228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.160047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.160355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.160627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.180961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.182956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.206587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:30.207792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 321/634] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.214414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.229477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b15c-8bdd-4b7e-9a1b-ec8100185350 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.239099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.239771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.240049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.240346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.241101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.241401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.242988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.262930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 314/635] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.269080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.282802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1d87-e888-4eb3-8925-f16a72cd82dc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.292133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.293098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.293379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.293650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.305439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.307548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.325974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 25 04:36:30.327492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 322/636] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.333638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.349282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921599a4-aa04-4dac-ac76-d1a751c725f9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.357240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.357923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.358203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.358471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.359390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.359696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.361680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.390423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 315/637] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.396989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.410534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a251-77bf-46ca-9c73-d6e8f65ab297 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.420451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.421209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.421512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.421779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.439956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.441743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.453832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 323/638] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:30.460260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.473390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c45c-6bc1-40ee-9d01-2b5a55a8f1dc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.484261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.485351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.485869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.486342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.505554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.507821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.537044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:30.540094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 316/639] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.545522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.557812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a569b2b-a2f9-4d7f-bc69-cf9d19d7f08d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.574222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.580094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.584489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.584768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.585551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.585852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.587551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.603693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 324/640] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.609864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.629187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d865c-f123-4320-b8de-1edd80163f84 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.640240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.641334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.641815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.642284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.657290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.659543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.676176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-c176d4f9-2754-4bdb-a20d-9272ca7190ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:30.677739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 317/641] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.684070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.686023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2ff8-969b-442e-9e05-0f9001eb0091 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.686315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2ff8-969b-442e-9e05-0f9001eb0091 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.686602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae2ff8-969b-442e-9e05-0f9001eb0091 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.688626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 318/642] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:30.694090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.694378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.694658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.699507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a4355-bf28-4ef5-ac48-1a4a5b512c76 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.714915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.715546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.715834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.716109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.717028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.717349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.719231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.726894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:30.728095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:30.739551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 325/643] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.749404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.750723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 319/644] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:30.770278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e483-7448-4543-98d9-f2f491be2351 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.778112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.778776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.779066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.779342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.780236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=c7db691378f74f4f8792b779ca0181f1) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.780553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.782398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.793144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 326/645] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/role_assignments?user.id=c7db691378f74f4f8792b779ca0181f1&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.798615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.813941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aa2ad-ff0f-4fe2-b50a-f3990d914676 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.823472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.824965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.825453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.825954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.842464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:30.850078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:30.856325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 320/646] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:30.858654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.879960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d68e7-c9c6-4924-bc3d-78f44f66671a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.892983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.893695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.893985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.894266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.895057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:30.895368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.897045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad6eb-c628-4687-a4a1-c3a775a37ac0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.912091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 327/647] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:30.918295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:30.920623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230187e2-ec6d-4347-a51f-e0f8f90a37fd None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.920914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230187e2-ec6d-4347-a51f-e0f8f90a37fd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.921189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230187e2-ec6d-4347-a51f-e0f8f90a37fd None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.923223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 328/648] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:30.929282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.929561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.929832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.931521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c7b-50bf-46f8-ad2b-881f4f764011 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:30.937193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:30.938644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:30.939219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:30.939696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:30.959543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:30.960820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:30.965149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:30.966957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:30.979843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 329/649] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:30.995077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:30.996789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 321/650] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.002843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.017981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8c16-6773-4b90-a3af-071ab251ba27 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.027116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.027805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.028090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.028393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.029167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.029470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.031119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.047907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 330/651] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.050344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.057610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.065947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516737a-e891-43e6-82e6-094da802cc4f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.076461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330543ea-8f96-485e-95e5-859a1c71a626 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.081567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.082424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.082709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.082984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.088955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.089952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.090234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.090507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.102893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.103882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:31.105106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.113183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:31.115389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 322/652] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.121503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.124690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:31.126201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 331/653] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.133137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.137962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfeb7-3dc0-4c2e-95ba-4ed6025f949d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.142802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.143802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.144333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.144866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.145877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.146378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.148393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.149943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17401-3483-432d-b9c8-190781a804f9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.161396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 323/654] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:31.165843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.166953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.167491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.167598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.168265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.169386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.169899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.172032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.180037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657eb74-534f-4249-a1ed-eea995261ab4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.186061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.187140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.187497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.187867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.196693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 332/655] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.204590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.204590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.206826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.223629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:31.226123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 324/656] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.227725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ffb2-8249-4c6c-b34f-9ddef54c3cbc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.235378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.243862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.244761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.246338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.246338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.250341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcaefb-90bc-4508-abb6-c67d85daba49 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.255948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.257852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.257981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.258974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.259445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.260051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.264173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.264715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.266569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.268238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 333/657] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:31.274003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.281790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 325/658] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.288386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.289805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e2cc2-4110-471b-90cd-8a9e347087cd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.294668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.295591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.296531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.296881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.300642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c0dd0-8242-4b02-abda-2c214ba6ef9b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.306272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.307823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.308721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.309209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.309485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.311593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.318871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.322039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.332097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:31.333807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 334/659] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.337245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 25 04:36:31.343706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 326/660] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.343866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.345230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.351108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbb48c-cf9a-499b-9462-91599edc2505 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.356459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.357137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.358081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.358365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.359295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.359612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.361285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.366665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ddbb8-5269-46f9-8929-e2ba6dc4cb2e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.374591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 335/661] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.382383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.384856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.385598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.385888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.386170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.387054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.387366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.389293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.400912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25f05c-bcbc-4d8d-93b4-031d18a2ef2f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.411225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.413325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.413616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.413890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.424469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 327/662] 10.222.0.36 () {56 vars in 1158 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.427343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.429498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.431761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.447045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1b820-237e-4e0d-aa83-fa4b0ef02c7a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.458445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.459126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.459416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.459689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.463904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:31.467881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 336/663] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.471487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.473367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.483162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 328/664] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:31.485674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.495798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.505549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123da9-9cf5-4d62-9fa1-9eb123826217 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.513218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bdf79-af2e-4dd8-a31d-e7af2f4de0b0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.516330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.517063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.517338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.517612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.518514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.518830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.521661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b858d3-f251-4ba8-a0c1-840fb64aebf2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.527688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.528624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.528906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.529179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.540255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 337/665] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:31.541964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b634f-601a-4795-ad37-675183c3d623 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.542251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b634f-601a-4795-ad37-675183c3d623 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.542413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.542559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b634f-601a-4795-ad37-675183c3d623 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.544248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.549846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 338/666] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:31 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:31.551079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b634f-601a-4795-ad37-675183c3d623 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.567248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-624753d6-1e40-4547-8f16-e02b9e9f41f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:31.568801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 329/667] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.570119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.570372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.570718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.573354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b634f-601a-4795-ad37-675183c3d623 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.583587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.584340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.584622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.584891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.585841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.586198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.588171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.589567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:31.590762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:31.595111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 339/668] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.595945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.605874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5fbb-5cdf-47fa-8b6e-93d3471066b1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.610743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.611604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.611924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.612265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.613128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.613481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.614505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 330/669] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:31.615154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.642352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 340/670] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.649037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.656691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.665967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90713e1-db8b-40d3-bea4-109c16d4b996 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.668912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e854a-bc1c-4c4b-a118-60a99e045232 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.676528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.677758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.678014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.678172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.678398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.678562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.678839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.679123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.687014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.689018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.691574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:31.699057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5100e890-1bbb-4036-bb79-9f297bcfbb4a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:31.700708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 341/671] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.702125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716643c-ccb3-4194-999a-f1bea5ea93fe None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.702475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716643c-ccb3-4194-999a-f1bea5ea93fe None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.702763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716643c-ccb3-4194-999a-f1bea5ea93fe None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.704665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 342/672] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:31.708208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-3910a4eb-6d79-4cee-ae3f-54ef39ed27e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:31.709688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 331/673] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.710391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716643c-ccb3-4194-999a-f1bea5ea93fe None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.710796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.711240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.711455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.724703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716643c-ccb3-4194-999a-f1bea5ea93fe None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.729573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.730428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.730814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.731222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.731781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:31.732362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.732822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.733004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:31.734828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.741255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 332/674] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:31.742159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.752380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 343/675] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.752633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6c1d-a058-48bf-a895-38e28cfe4a8e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.759475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.763163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.764000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.764325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.764689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.765549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.765899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.767884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.781210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 333/676] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.781990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73035-52e4-4bc4-bc7b-25279075cd69 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.782111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.786980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.788008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.788459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.788833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.792998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3ef8-6a6b-4bcf-b5d5-803291dc1e81 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.797759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.798651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.799012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.799373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.801677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.803671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.811712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:31.819073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:31.820584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 334/677] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.826923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.829921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:31.831632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 344/678] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.832595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.837096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f8bec-d052-4b02-b236-cdaf1a028405 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.847364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7004d-0e2c-4650-a5dc-ccfb2cc6579a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.851996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.852870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.853185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.853521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.854594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.854815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=140bf1d478d74252a94ab359064731dd) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.855208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.855494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.855848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.856243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.857486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.857895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.858295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.859908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.865189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 335/679] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/role_assignments?user.id=140bf1d478d74252a94ab359064731dd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.866002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.871294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 345/680] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.878216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.883388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585db12-88a4-43c9-bff4-b2e55eed52a1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.889816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.890031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c36c0-c235-48d2-90c2-932e55474df1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.891006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.891552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.892046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.893085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.893634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.894400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.895206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.895488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.895759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.896486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.912288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.913554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 336/681] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:31.916416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.919880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.930445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1043bb-814a-46fe-9b3e-bfd7bc142a11 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.935084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:31.936507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.937300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 346/682] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:31.940255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.940255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.940255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.944519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.950589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.953143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.955850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3488-7935-45e1-9563-c149e3b7e29e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.963342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:31.964210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:31.964477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:31.964722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:31.965504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:31.965811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:31.967462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:31.973089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 25 04:36:31.975454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 337/683] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:31.982049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 347/684] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:31.982620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.988461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:31.994211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e6f8a-ec7e-47e8-b522-839fb6310cf7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:31.999891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.001006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.001200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da7c2-d4da-4adf-92bb-2882d9d1375a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.001722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.002278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.003464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.004010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.005895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.006707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.006989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.007265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.007494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.017439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.021399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.029821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 338/685] 10.222.0.36 () {56 vars in 1160 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:32.036527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.038314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:32.044772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 348/686] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:32.046395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.050381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb166-47c7-4dc9-807f-59a81f101b53 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.057499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694868f-5e80-428f-a9a2-35d6709e803a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.059970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.060702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.060993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.061275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.062405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.063096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.063377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.063658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.065101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.065412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.067657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.071311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.074481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.088078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 339/687] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:32.094785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.098285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 349/688] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:32.099335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.104914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a11c-0a3f-4d74-82a3-a02e76f11889 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.112909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb697f-010a-47a0-8520-9c524e8aa0d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.113704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.114972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.115462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.115903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.117541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.118436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.118931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.119207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.131060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.133413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.133526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.136077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.155987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:32.156718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:32.157556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 350/689] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:32.158437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 340/690] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:32.163765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.164106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.175627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515b28-b36b-41fe-8238-244dd46e8085 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.175837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f461e-f71b-4c29-9d23-e0e4553dd051 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.180247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.180895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.181175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.181359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.181487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.182193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.182334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.182773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.182953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.183417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.184394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.184558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.184878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.186860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.198499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 351/691] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:32.203038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 341/692] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:32.204910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.208955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.215391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573744e-46ec-4378-b96b-729f3db141b7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.220527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.221349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.221629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.221899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.222575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965895-e06e-4df6-a0f8-13a231bada49 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.227794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.229072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.229529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.229944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.230077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.232261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.239626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.242034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.250328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:32.251899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 352/693] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:32.257795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.259241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:32.261150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 342/694] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:32.266881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.269489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55dcf4-b7a6-49c4-9782-0783d8ea269b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.275984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.276911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.277287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.277928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.278877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.279282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.280546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883d639-01d1-4b89-8cdb-780528e8a7c5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.281373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.291690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.292684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.293064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.293440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.294361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.294766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.296755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.296884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 353/695] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:32.305001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.314119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 343/696] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:32.317720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad5ae-abcb-4ed8-8029-2f0835ed052e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.319598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:32.322627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.323581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.323868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.324168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/86de70eda88d4d4ea1fdd4bc96bc6ff8/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.335030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb3816-c15c-467a-968b-e1f430f3ee37 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:32.340941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=86de70eda88d4d4ea1fdd4bc96bc6ff8, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.341436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:32.342336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:32.342877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:32.343453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:32.343555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d047509-652c-414f-8276-d26b92f2c152 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.344600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=7f881943403942878b4ac80e11c2f5a6) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:32.345142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:32.348003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6561f-995a-4adf-a1df-4ff4db64892b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:32.356140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 344/697] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:32 2021] GET /identity/v3/role_assignments?user.id=7f881943403942878b4ac80e11c2f5a6&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:32.359528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 354/698] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:32 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/86de70eda88d4d4ea1fdd4bc96bc6ff8/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:36:33.914410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad445-88f6-4b10-afbc-7ea6168fc932 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:33.914959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad445-88f6-4b10-afbc-7ea6168fc932 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:33.914959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad445-88f6-4b10-afbc-7ea6168fc932 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:33.916979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 345/699] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:33.923034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:33.923503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:33.923595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:33.941677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:33.942846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:34.026235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 355/700] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:34.059931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaad445-88f6-4b10-afbc-7ea6168fc932 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.082159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaad445-88f6-4b10-afbc-7ea6168fc932 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.091681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.092520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.092804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.093080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.112059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.113961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.142352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:34.143934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 346/701] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:34.150140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.163418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e74736-3c05-41e4-973c-5e9b57160d75 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.174138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940510a-4387-415c-9451-416b45574dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.174751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940510a-4387-415c-9451-416b45574dab admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.175030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940510a-4387-415c-9451-416b45574dab admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.175302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940510a-4387-415c-9451-416b45574dab admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.176046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940510a-4387-415c-9451-416b45574dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:34.176371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940510a-4387-415c-9451-416b45574dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.177978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940510a-4387-415c-9451-416b45574dab admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.199997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 356/702] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:34.206578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.219634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48529ca-c943-4aa9-a873-35e85217b9cf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.228239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.228920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.229302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.229739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.230522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.232486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8ff75-e66a-47c5-b18f-2bd2d6c011ad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.266099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 347/703] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:36:34 2021] POST /identity/v3/users => generated 254 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:34.749585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6cc5-3186-4441-acf1-ec9de677953e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.749929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6cc5-3186-4441-acf1-ec9de677953e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.750127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6cc5-3186-4441-acf1-ec9de677953e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.751898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 357/704] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:34.758042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.758330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.758610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.779756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:34.780987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:34.789095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 348/705] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:34.813829 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e6cc5-3186-4441-acf1-ec9de677953e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.826826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e6cc5-3186-4441-acf1-ec9de677953e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.831134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.831938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.832261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.832541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.844943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:34.852168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:34.853820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 358/706] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:34.860581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.870294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8fd9-114d-412e-ba19-e74f31cf301e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.875377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.876088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.876406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.876682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.877492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:34.877796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.879437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.889030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 349/707] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:34.895223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.905978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad69973-51d7-47db-9821-8bae7cb573c4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.910450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.911300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.911580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.911853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.923050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.924972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.942354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:34.943923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 359/708] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:34.952031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:34.962087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c811480-0ad1-477e-b25f-696a925354d5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:34.966876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:34.967594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:34.967933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:34.968268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:34.969011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:34.969313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:34.970902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:34.983637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 350/709] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:34.989649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.000691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8339eb4-d643-4b4a-9abc-0caa35df0f41 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.005282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.006073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.006354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.006621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.014779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.016973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.031698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-cf4b68a6-de91-4545-83ce-38826fca40e4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:35.033315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 360/710] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.039513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.049808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7073f-a032-4a11-b43e-2ba2fd361603 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.056393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1509a5-a829-439c-95ea-df2114a7b28c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.056393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1509a5-a829-439c-95ea-df2114a7b28c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.056393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1509a5-a829-439c-95ea-df2114a7b28c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.057887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 361/711] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:35.060389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.061090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.067670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.067670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.068068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.068068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.068068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.068844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.068844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.070081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.090870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 351/712] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.093462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:35.094953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:35.102510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.117810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741851d-fd80-4ecd-9b2a-23811651a913 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.118868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 362/713] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:35.128015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.129061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.129596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.130084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.144744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.146933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.158213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 352/714] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:36:35.163881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.171681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.176378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d3ff-a598-42a8-9c33-3d0f07822a63 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.182435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.184827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.185394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.186041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.190410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9319-9e65-433b-bb37-15df60f20b87 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.201046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.203912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.204455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.205194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.206229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.209027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:35.209027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:35.209027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:35.210274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.212357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.214563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.237209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 25 04:36:35.245927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 353/715] 10.222.0.36 () {56 vars in 1150 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.246675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:35.248725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 363/716] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.252779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.254628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.268535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fb917-0dd6-498f-9e74-c0957e52fd91 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.275455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ab78-0210-4b7f-8bc5-78f0e419f37a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.278920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.280268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.281138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.282466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.284435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.284959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.286524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:35.286524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:35.286524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:35.288364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.289266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.290087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df720-896b-4740-bdf1-33b66940607a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.290582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.292466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.293437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.294511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.296199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeef51-7b55-4127-b6a2-963dbd4e74d4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.299663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 354/717] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.301191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26ea6-e68e-4264-8e63-3509380e9bb2 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.301668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26ea6-e68e-4264-8e63-3509380e9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.302088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b26ea6-e68e-4264-8e63-3509380e9bb2 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.308199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 355/718] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:35.309268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 364/719] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.310653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b26ea6-e68e-4264-8e63-3509380e9bb2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.315388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.316083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.316819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.332200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b26ea6-e68e-4264-8e63-3509380e9bb2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.342304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:35.343401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:35.347545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.348243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.348535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.348812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.349555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.349859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.351656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.356328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 365/720] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:35.357493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.358030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 356/721] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:35.374212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9da745-e3f5-44f7-a655-028f8230496a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.381333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.385163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.386236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.386673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.387091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.395324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.397886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.408583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da69fb-9bb3-4052-b9f7-cb1447b91109 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.417842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:35.419701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 366/722] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.425450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.426159 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.426295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.426534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.426809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.440036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a53e-5f43-416d-89d5-85e05c37da20 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.445364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.446538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.447006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.447475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.448564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.449455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.451739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.456809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:35.463975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:35.467355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 367/723] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.470851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 357/724] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.471910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.473839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.488957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab080-86e0-4d13-8b76-72ab2045d0eb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.493779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94730-13b1-4b79-adc8-372e9e7ff3d6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.500754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.501451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.501730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.502002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.502821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.503130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.504817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048ad1b-9a04-4d64-83b8-24c3b2cb5024 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.508279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.508980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.509243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.509509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.510522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.510935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.513253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6495a2-c02a-4195-9972-092266d5baf8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.523424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 358/725] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.523757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 368/726] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.531165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fe88-3609-4b8a-bb57-cf6f85f47429 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.531165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fe88-3609-4b8a-bb57-cf6f85f47429 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.531165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fe88-3609-4b8a-bb57-cf6f85f47429 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.531165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 369/727] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:35.532763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fe88-3609-4b8a-bb57-cf6f85f47429 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.538621 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.539318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.539757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.570785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:35.572486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:35.582040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fe88-3609-4b8a-bb57-cf6f85f47429 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.587917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.591141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.596751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.597306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.597954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 359/728] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 25 04:36:35.611975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.614476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.634266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:35.636565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 370/729] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.645360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.645588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.660046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511f6d8-fa34-47b8-8e2d-83a5cbf28472 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.665645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a2e5e-ec10-48b9-8893-5472b9a96c25 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.671049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.671761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.672040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.672347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.673121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.673428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.675136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.679048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.679901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.680211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.680491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.681194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.682277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:35.682277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:35.682277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:35.683201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.703301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 360/730] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.712915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 25 04:36:35.714532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 371/731] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services/network => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.717912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.722262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.729478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dff894-da93-40c3-9f5c-7b00be67d7ff admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.734107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.734938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.735222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.735497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.739989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853e540-d5d9-4da4-b0c0-d4cc24e346c0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.749585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.753070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.753464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.754156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.754437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.754708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.755446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] RBAC: Adding query filter params (name=network) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.755749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.756799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:35.756799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:35.756799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:35.757673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.769894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 372/732] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:35.776545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.783300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:35.784904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 361/733] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.788420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86379573-08df-4f0d-a9e6-8c8fc87f398b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.792101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.794486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.795278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.795659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.796036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.796887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] RBAC: Adding query filter params (type=network) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.797298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.799059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.805391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9e7d-788a-4972-bd35-f2761b9fc0c6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.812179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 373/734] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:35.816082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.817034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.817414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.817787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.818835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.819256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.821467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.843376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 362/735] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:35.849427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.860390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e1a6-32ba-4ad7-a1aa-10068d301783 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.865208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.866019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.866449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.866818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.876743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.878729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.889582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 374/736] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:35.896639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.907538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d4c1-fb36-499f-8fdb-e1f649cbd02a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.912414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.913364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.913741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.914119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.926151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.928053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:35.951333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:35.957108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 363/737] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:35.963940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:35.977623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e534b4-b29a-42cc-afb5-bf6999843534 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:35.986665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:35.987332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:35.987663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:35.987985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:35.988765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:35.989068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:35.990670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:36.007705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 375/738] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:36.014605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:36.030354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7401d-a7e3-47ba-a767-c1ebdf9abc8b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:36.038326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:36.039156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:36.039438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:36.039713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:36.047927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:36.049942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:36.064722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:36.066176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 364/739] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:36.072498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:36.083455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a26b0-5ded-4e91-8006-3cd816060041 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:36.087955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:36.088890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:36.089264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:36.089687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:36.090712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:36.091070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:36.092954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e01b-2b2c-4bd3-a670-8a9fa46cfd91 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:36.106209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 376/740] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:36.112919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:36.126847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948bea-4ac1-4fbf-9b45-90f78b91ad7f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:36.132230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:36.132882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:36.133192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:36.133423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:36.134377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:36.134691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:36.137045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206fdb9-b784-4b87-ba1f-48f20ba1f99a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:36.149915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 365/741] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:36 2021] GET /identity/v3/role_assignments?user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:37.431331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87e758-6b33-4b96-803a-e2915e5b381f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.431901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87e758-6b33-4b96-803a-e2915e5b381f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.431901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87e758-6b33-4b96-803a-e2915e5b381f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.435409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 377/742] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:37.444476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.444918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.445014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.473241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:37.474426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:37.485362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 366/743] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:37.521964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87e758-6b33-4b96-803a-e2915e5b381f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.538147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87e758-6b33-4b96-803a-e2915e5b381f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.549503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.550377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.550735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.551007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.573081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:37.584181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:37.584373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 378/744] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:37.588480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.601073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b7803-ce63-45ea-8d90-b6e5c8638480 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.608028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.608779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.609059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.609329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.610158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:37.610500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.612136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.630040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 367/745] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:37.636294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.649314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f1e9-79c8-4bd6-947d-07fa1206052c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.654720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.655578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.655859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.656129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.670579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.672436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.693666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:37.694810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 379/746] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:37.701116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.713531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37f87c-42fd-4923-be81-844f796fb8e2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.725331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.726016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.726303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.726579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.727328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:37.727635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.729377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.749981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 368/747] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:37.756197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.771430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c09c-a078-4fdc-a9b8-baa55092f202 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.782887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.783777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.784111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.784405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.801636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.803784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.823614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:37.824739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 380/748] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:37.833514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.846136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e3846-4615-449e-b6f7-0a1def3cbfa6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.861683 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.862367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.862651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.862928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.863802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:37.864108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.865994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.884897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 369/749] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:37.891069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.905936 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee16bbd-0ad9-45f3-82a6-d8e08cffe01c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.914496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.915143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.915423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.915696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.931889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.933888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:37.945564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 381/750] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:36:37.951919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:37.962131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0bcdc-f52a-4f6f-925f-231855c0492e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:37.972462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:37.973351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:37.973639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:37.973913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:37.987626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:37.994661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.019731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:38.021684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 370/751] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.027661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.041199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d4f1-e032-427c-af64-38e1db548f14 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.049743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.050439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.050718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.050989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.051911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.052308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.054003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.072292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 382/752] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.078005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.093920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09fdd6-efbe-4c48-9702-9b01de616016 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.103726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.105785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.106306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.106771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.114406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.116630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.135319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:38.141136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 371/753] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.147400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.161824 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c332b-ff68-45ff-a659-11c5bbfd60af admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.177925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.178625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.178907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.179177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.179989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.180324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.182248 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc47cc7-b3e2-4e9a-ac13-f64cc382d6d6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.204199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 383/754] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.210785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.229429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdf249-f202-4850-9ddb-fa931bf193b6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.239733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769fc0-3be8-489e-a829-66963848b18d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.240020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769fc0-3be8-489e-a829-66963848b18d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.240332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769fc0-3be8-489e-a829-66963848b18d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.240681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.241583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.242060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.242395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 384/755] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:38.242762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.243869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2403ee720a14460c9eb69191acfda31a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.244399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.246692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.247810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.248459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.248738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.255792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 372/756] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/role_assignments?user.id=2403ee720a14460c9eb69191acfda31a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.289389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:38.290625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:38.302983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 385/757] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:38.350481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.360692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509758b-5b6b-4c24-93c3-91afd410a849 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.372829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.374034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.374318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.374590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.392293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:38.409934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-4b900bf1-0562-41f9-aa80-e4fbe3226b9b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:38.411409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 373/758] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.417703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.426839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ce80f-368b-4ce2-9767-82c48c698902 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.436704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.437433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.437801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.437968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.438696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.439001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.440658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.456732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 386/759] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.461895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e80d5-10c7-4667-9acd-fbcc833fbf6e None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.462507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e80d5-10c7-4667-9acd-fbcc833fbf6e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.462507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e80d5-10c7-4667-9acd-fbcc833fbf6e None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.464836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 374/760] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:38.467616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.472721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.473012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.473286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.497667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f3eac-52f9-4b75-acf1-534b4714d83c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.499699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:38.500935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:38.507500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.508346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.508629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.508897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.515091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 375/761] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 25 04:36:38.535595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.537641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.540065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.558070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f1f0d-615d-4545-acbb-fc5f6f809428 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.560619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:38.562300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 387/762] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.574879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.581370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:38.588178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:38.588762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.604330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952758c-454b-406a-889f-ae7b9160f1be admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.605778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 376/763] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:36:38 2021] POST /identity/v3/services => generated 251 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:38.647390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.648555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.649063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.649580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.650603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.651346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.653412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.667122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 388/764] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.673614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.694072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ae5d-d418-4d43-b0b1-c6414d1721f7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.704168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.705071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.705412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.705696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.717591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.719680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.736318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:38.737981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 377/765] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.743937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.762297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cfee8-47f3-4e6e-b236-84fc931cbbf2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.772523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.773326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.775546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.775546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.775546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.775546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.777298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.814725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 389/766] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.820992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.835931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b72e8-0afb-4a83-a757-fa16459b2a71 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.844895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.846129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.846720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.847217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.860383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.862690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.881821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-217be9cd-236a-4f8e-9d34-69944c8522b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:38.883773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 378/767] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:38.891489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.909927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270da041-faf7-48b6-9d45-cb519edcc932 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.920663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.921358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.921640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.921916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.922695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:38.923008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.924712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.948890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 390/768] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:38.951002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312124-e3e6-4b2a-929a-647689d7cd1f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.951297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312124-e3e6-4b2a-929a-647689d7cd1f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.951571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99312124-e3e6-4b2a-929a-647689d7cd1f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.954474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 379/769] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:38.954785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:38.958960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.959243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.959515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.966304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d28978-d698-4607-a0f0-ef166e00263c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:38.971877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:38.972726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:38.973014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:38.973297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:38.981204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:38.983176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:38.984314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:38.985532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:38.998530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:39.000208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 391/770] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:39.000435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 380/771] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:38 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:39.005810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.016312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dffd4-5bf3-48ca-aed7-a8d97cf4ce4f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.020933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.021583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.021910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.022179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.023109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:39.023416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.023962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.025415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.033071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d24455-8d32-45fe-998f-66ae0a0da1a6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.037628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.038303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.038583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.038853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.039601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.039908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 392/772] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:39.041394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643a0fc-dc5c-4cc2-90f0-f52f5c766f70 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.049255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.059432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 381/773] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:36:39 2021] POST /identity/v3/services => generated 240 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:39.062246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0040-0168-4dee-8397-276cb251b2b2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.087550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.088611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.089031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.089558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.092206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=2a5832639148459ca8895ae9e26e4b1a, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.095291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d88dc-9d1a-4b23-80df-f451231c4124 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.126980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 393/774] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:39 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:39.541207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c853-1335-487a-b966-42b7c470669a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.541809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c853-1335-487a-b966-42b7c470669a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.541809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8c853-1335-487a-b966-42b7c470669a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.543864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 382/775] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:39.550152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.550601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.550777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.581164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:39.582446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:39.669897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 394/776] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:39.718555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8c853-1335-487a-b966-42b7c470669a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.740512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8c853-1335-487a-b966-42b7c470669a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.747071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.748257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.748773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.749054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.764110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:39.771318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:39.772957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 383/777] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:39.779340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.795016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aca50-35f8-45ef-b897-5a6db6c4900f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.804212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.804889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.805176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.805449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.806230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:39.806531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.808727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.824408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 395/778] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:39.830226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.848373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba7c6-7e0e-424a-88cc-9ba2dd8cefaf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.856417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.857282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.857560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.857830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.876350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.878222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.908262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:39.909849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 384/779] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:39.917924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.934754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d52d8-1a05-415e-b5bd-255596b65a1f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.943755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.944488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.944758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.945040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:39.945786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:39.946086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:39.947660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:39.961395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 396/780] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:39.967696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:39.981506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c214d3-5fd0-4d1a-a7b1-76cb442ee5f4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:39.992856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:39.993687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:39.993973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:39.994250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.013176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.016722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.038262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:40.039844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 385/781] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:40.049818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.066118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d444ca-9595-4f65-8e1f-892cf82ea251 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.073814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.074580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.074837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.075114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.076044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:40.076377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.078293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.108573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 397/782] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:40.114654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.130803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46a965-721f-46d9-acda-95ec442daeed admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.149816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.150497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.150781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.151107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.160075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.161873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.178593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 386/783] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:40.185762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.205929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad12b-a1d5-4e3d-8789-b1ed8bc11d46 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.219997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.221311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.221606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.222006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.238816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.245589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.271138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:40.277731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 398/784] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:40.284227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.302365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edab4d-9f10-4cf7-a1a8-aa00d184ff81 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.317024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.317024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.317024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.317024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.317851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:40.317851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.317851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.346735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 387/785] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:40.352989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.370372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51db06-4149-493d-83c2-1a84902373f4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.380969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.382031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.382438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.382786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.397523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.399519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.424121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:40.425859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 399/786] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:40.434992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.455398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1a635-1efd-4748-86b6-c87fe63c418e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.460444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.461405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.461887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.462387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.463446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:40.464061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.466231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764305-0225-44d0-a648-4e1092173e2d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.496871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 388/787] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:40.502270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:40.524346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5571f-15c9-470a-8251-89f62a70cd68 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:40.537854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:40.538603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:40.538882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:40.539152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:40.540010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:40.540344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:40.542575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c518ba-e661-4bcc-b3df-3b831db03b21 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:40.553163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 400/788] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:40 2021] GET /identity/v3/role_assignments?user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:41.496618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311197d-4afd-4959-af2c-3fd60932d10a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.497286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311197d-4afd-4959-af2c-3fd60932d10a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.497286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311197d-4afd-4959-af2c-3fd60932d10a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.499661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 389/789] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:41.505878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.506158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.506428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.528805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:41.529978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:41.543179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 401/790] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:41.594049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311197d-4afd-4959-af2c-3fd60932d10a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.609775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311197d-4afd-4959-af2c-3fd60932d10a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.614280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.615087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.615363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.615632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.631230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:41.638342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:41.639902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 390/791] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:41.646195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.661174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9368fa-0797-4b3f-b2bc-6eb5836e2358 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.671749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.672630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.673085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.673497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.674431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:41.674876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.676630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.685828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 402/792] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:41.692389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.702850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70646-730b-4028-8662-1b2c87d5d1ce admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.715315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.716198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.716480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.716750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.731519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.733455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.754821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-1b8926af-4140-4ec3-942d-460f1921a552 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:41.756308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 391/793] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:41.762458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.777431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510813fa-6b43-488a-af6b-9cee200ec903 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.787752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.788630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.789081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.789508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.790393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:41.790838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.792794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.802315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec34fd-7ff3-4625-9f6f-41f082282401 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.802746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec34fd-7ff3-4625-9f6f-41f082282401 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.803124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec34fd-7ff3-4625-9f6f-41f082282401 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.805363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 392/794] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:41.814668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.814959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.815213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.815368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 403/795] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:41.821281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.834300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25e889-d674-45fd-931b-837290d42c4e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.850519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.851364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.855515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.855796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.862398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:41.864402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:41.869941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.874127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.881760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 393/796] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:41.896990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:41.898601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 404/797] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:41.904812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.912742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.918584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fcd7b-894a-4af4-a922-d3710d03035f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.923129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b282dac-528e-45c4-b881-635c5931c7be admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.923540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.924417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.924834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.925242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.926237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:41.926698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.928720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.946321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.947397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.947965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.948652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.949518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:41.951232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:41.958144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 394/798] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:41.966888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 25 04:36:41.968026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.973737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 405/799] 10.222.0.36 () {56 vars in 1150 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:41.978185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e0f8-e51f-4da4-9a84-c21d8db6fef2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:41.980764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:41.983605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:41.984661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:41.985132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:41.985588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:41.994654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5b74-8a0b-43d7-8db6-3825431b52f7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.005399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.007970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.010157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.011367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.011871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.012389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.013320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.013812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.015875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.027370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 406/800] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.040222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:42.041067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.046925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 395/801] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:42.054036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.057031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b218a-2c97-4d85-8669-22ecfca269ed admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.065678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.066368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.066648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.066921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.067654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.067956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.069592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.076175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1442-ae37-4b30-987f-5fd275cca0d1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.082514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 407/802] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.083819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.084518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.084798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.085072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.085811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.086115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.088399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.093591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.104214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51507cf3-14ea-431b-95e1-6712926a8ec0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.113528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.114212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.114491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.114761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.115574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] RBAC: Adding query filter params (interface=public, service_id=3098592d817a495ab4da35e8211fde86, region_id=RegionOne) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.115880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.116304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 396/803] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.122216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:42.122216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:42.122216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:42.122851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.123427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.136993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 408/804] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/endpoints?service_id=3098592d817a495ab4da35e8211fde86&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.146317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b01ddd-e309-4449-9981-b654f2bbab86 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.147961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.159649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.160474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.160755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.161028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.171128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.173127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.175555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ef6b-0143-4299-a414-715190420470 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.186411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.187071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.187351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.187618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.188347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.189911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.198451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:42.202128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 397/805] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:42.207990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 409/806] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services => generated 772 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.208387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.225068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d8d8-db37-4fd9-a232-71909f60d8ba admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.232788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.233474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.233755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.234027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.234849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.235156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.237166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fad65-24b6-4260-89f2-8333392af3b9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.262707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 398/807] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.269045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.290727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5d656-17eb-4183-9472-6d65574377a6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.299977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.300935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.301218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.301494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2403ee720a14460c9eb69191acfda31a/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.323987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=2403ee720a14460c9eb69191acfda31a, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.325787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95180c-4eb2-4951-8731-78c32b26696c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.326074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95180c-4eb2-4951-8731-78c32b26696c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.326347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95180c-4eb2-4951-8731-78c32b26696c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.326640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594b71-a2bd-4406-be6d-66c5bd8a6c8d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.328539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 399/808] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:42.336607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.337258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.337731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.355943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 410/809] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:42 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2403ee720a14460c9eb69191acfda31a/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:42.357871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5aa3-cfae-42a6-b5c1-4f3132875e68 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.358160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5aa3-cfae-42a6-b5c1-4f3132875e68 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.358433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5aa3-cfae-42a6-b5c1-4f3132875e68 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.360601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 411/810] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:42.361728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:42.363229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:42.366941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.367237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.367502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.409599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:42.410869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:42.491929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 400/811] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:42.529835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 412/812] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:42.546944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.555358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.558973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d978fd0-e18c-41b6-9e7b-126635777acc None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.566079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034dc47-c63d-48f7-ac73-2632763d1fcc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.572225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.573524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.574122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.574639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.583706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.584651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.584927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.585194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] PATH_INFO: `/v3/services/network` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.585868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.587485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.590822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:42.598031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:42.599808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 413/813] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:42.609322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 25 04:36:42.610731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 401/814] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services/network => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:42.613191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.618296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.625501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8416d-c049-4948-9f4c-f28d4a0d9c8c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.630440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.630772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea909b-aed0-47b9-8f9c-181d05260417 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.631697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.632202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.632675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.633837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.634441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.636942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.637174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.637842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.638118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.638392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.639121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.639421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.641037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.646201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 402/815] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.648969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 414/816] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.652970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.665771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb73c4-751e-40bb-851f-d317c325cbb5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.666565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.672314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.673243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.673763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.674270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.675215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] RBAC: Adding query filter params (type=network) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.675604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.677383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.680121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf2927-235e-47d4-b82b-64016b67d68b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.683339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 403/817] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.687547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.688789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.689247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.689694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.690230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.700392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0641e2a-4eec-4b19-9309-773e3831fb10 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.703270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.705025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.705731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.706043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.706162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.706395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.707270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] RBAC: Adding query filter params (interface=public, service_id=7fa7c221067943088d1a0e33482f35dc, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.707700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.708812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:42.708812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:42.708812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:42.709722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.718003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 404/818] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/endpoints?service_id=7fa7c221067943088d1a0e33482f35dc&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.723666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.727522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:42.730302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 415/819] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:42.736668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.739048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c359c-4750-49ce-abdc-5211f52f59f6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.749142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f97e2-5173-48b1-a0a4-2a97b92fd4aa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.750871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.751819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.752430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.752954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.753668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.754122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.754429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.754776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.755114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.755922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.756323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.756981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.758025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.763694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 405/820] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.774193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 416/821] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:42.780744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.791060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd31a0-c852-497e-95f8-74bb7a95c71b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.796049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.796971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.797303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.797574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.806604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.808884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.832092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:36:42.833595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 406/822] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:42.840259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.852982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d51fa-8ea3-4311-a2af-c0b16f8f671f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.860413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.861146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.861479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.861793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.862664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:42.862968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.864968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.891035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 417/823] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:42.897266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.908200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ebd2-6a71-4400-9fc5-bb4c80e496f4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.917989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.918704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.918984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.919306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.932387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.934350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:42.950099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 407/824] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:42.956579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:42.969534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b42403-7fdd-4aa0-be1f-8b103b5b4d09 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:42.975856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:42.976758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:42.977041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:42.977313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:42.992019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:42.993950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.012971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:43.014587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 418/825] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:43.020698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.033322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabdad5-0328-417f-9c9e-9bc98f24d375 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.038773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.039496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.039774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.040082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.040909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:43.041210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:43.043105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.058623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 408/826] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:43.064546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.074653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebda66b-5a30-495f-a575-a0487aa0b9fc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.079284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.080112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.080419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.080688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.090242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:43.091631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.112048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:43.113662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 419/827] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:43.119959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.131611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2875d6-ff69-4f49-b76e-9ee215875cee admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.136294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.136962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.137301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.137570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.138433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:43.138781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:43.140688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6075ae-f964-4b92-ab87-e4e8e8e411ac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.155506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 409/828] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:43.162272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.173050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c6a82-c686-43a0-bfca-b701a59657cd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.177980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.178787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.179208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.179622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.180668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:43.181135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:43.183326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382f26d-b478-420d-b60a-8cf31c4b23c6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.189750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 420/829] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:43.796746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc97e0-fcf6-4635-b508-e7c612f6b8f3 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.797817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc97e0-fcf6-4635-b508-e7c612f6b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.798321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc97e0-fcf6-4635-b508-e7c612f6b8f3 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.800874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 410/830] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:43.807554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.808810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.809300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.837240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:43.838846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:43.846898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 421/831] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:43 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:43.883652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc97e0-fcf6-4635-b508-e7c612f6b8f3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.902227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc97e0-fcf6-4635-b508-e7c612f6b8f3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.908553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.909733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.910205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.910686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.926743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:43.934129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:43.935955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 411/832] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:43.942236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.952421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c80c6-f221-4f77-b2c9-046ae82a0e24 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:43.960262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:43.960954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:43.961232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:43.961549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:43.962330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:43.962635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:43.964497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:43.978673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 422/833] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:43.984811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:43.997056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5778-e3a3-4d5e-84fa-31a81d23f142 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.008258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.009341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.009936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.010489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.032020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.034329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.058260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:44.060096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 412/834] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:44.066090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.080762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098071be-428c-4bdd-ade9-a6ece5304819 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.085257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.085920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.086247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.086526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.087338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:44.087589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.093296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.112015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 423/835] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:44.118007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.128524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31604f-7401-4bc4-8e40-b516edbe58db admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.133073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.133906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.134231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.134509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.143100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.145188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.158845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:44.160346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 413/836] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:44.166246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.191342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963acd9-03e8-4510-80d0-e059463923ed admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.206290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.206971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.207258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.207535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.208423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:44.208738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.210599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.243379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 424/837] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:44.249978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.262255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab218c-659e-4250-8a63-0f89630ea18d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.271063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.271933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.272237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.272516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.288360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.290262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.317211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:44.318492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 414/838] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:44.324786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.341291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb11e2a-02c6-40cf-81df-422f34f550fa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.353694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.354440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.354720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.354995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.355740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:44.356041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.357686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.377997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 425/839] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:44.384248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.394397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f986d5-6d50-4dda-968f-448b5bb152ca admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.403861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.404702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.405038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.405314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.412892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.414849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.434124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:44.436309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 415/840] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:44.446654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.461244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd092bfd-e9bb-4ab5-953c-fd8bb9fc6255 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.467263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.467946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.468253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.468530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.469341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:44.469647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.471524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6d74-3610-4640-ad09-2049198039ae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.489643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 426/841] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:44.496182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:44.509332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1ed17-8488-4027-800c-9377ce84e34c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:44.518693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:44.519600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:44.519887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:44.520174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/86de70eda88d4d4ea1fdd4bc96bc6ff8/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:44.522255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=86de70eda88d4d4ea1fdd4bc96bc6ff8, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:44.524977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ea3c-13a1-48b3-bead-fe6c58edae38 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:44.551499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 416/842] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:44 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/86de70eda88d4d4ea1fdd4bc96bc6ff8/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:45.048316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220163-6733-4d5e-a7a0-e60ca9690d8f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.049054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220163-6733-4d5e-a7a0-e60ca9690d8f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.049054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220163-6733-4d5e-a7a0-e60ca9690d8f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.050828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 427/843] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:45.057303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.058317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.058317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.085146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:45.086341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:45.156664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 417/844] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:45 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:45.200542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84220163-6733-4d5e-a7a0-e60ca9690d8f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.218048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84220163-6733-4d5e-a7a0-e60ca9690d8f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.222612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.223441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.223724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.224004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.224718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.226335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.244522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-56ce2449-1160-494f-9253-a2953a479091 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 25 04:36:45.245763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 428/845] 10.222.0.36 () {56 vars in 1150 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:45.252889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.262596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa5e9-c474-4c69-b065-d0ba137d2394 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.268624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ebcbd-8e32-4676-b9ac-89cca1cd1564 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.268917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ebcbd-8e32-4676-b9ac-89cca1cd1564 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.269183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ebcbd-8e32-4676-b9ac-89cca1cd1564 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.271268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 429/846] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:45.271888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.272699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.272985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.273263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.274031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.274337 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.277463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.277755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.278033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.280681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.286304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 418/847] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.292806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.296895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:45.298081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:45.305101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a270b59-cee5-4f3c-9cf9-676bc0e74404 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.306196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 430/848] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:45 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:45.316854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.317560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.317841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.318119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.318891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.319201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.320843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.331719 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.332600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 419/849] 10.222.0.36 () {56 vars in 1145 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:45.339397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.342005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726a7b1-0ac6-4a66-b2fd-3a87ab535fc6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.353035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.353035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.353035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.353589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.356897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b8fb-7460-4384-b1f1-ed43d9cfd3bb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.366630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.368370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.368652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.368926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.370703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.371732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:45.371732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:36:45.371732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:36:45.375024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.376976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:45.388038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:36:45.390851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 431/850] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:45.401103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.412298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8f60-93a6-4884-8722-e9a320de3e43 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.422696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 420/851] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:36:45 2021] POST /identity/v3/endpoints => generated 346 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:45.448185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.449063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.449401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.449724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.450591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.450907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.452685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.469298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 432/852] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.475553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.488054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb83c9-138f-47b0-b831-4585214ed489 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.497049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.498345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.498636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.498915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.514069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.515926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.538638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:45.540390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 421/853] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:45.546850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.557211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c50d-f4db-4067-8041-7a619b54233a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.561936 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.562625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.562955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.563239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.564015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.569345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.569345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.582401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 433/854] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.589133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.599455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004426-4ef9-4887-9eef-ffd9831e02ef admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.605533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.605533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.606449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.606449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.616864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.618975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.634518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:45.636228 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 422/855] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:45.642672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.653146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33409-8f8c-4450-a1fe-c1e6f02fd5b6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.657973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.658673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.659000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.659284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.660205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.660525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.662447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.682943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 434/856] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.689180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.699709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f953cc-5a45-4320-a594-45d25c78840f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.704501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.705166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.705451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.705725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.715144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.717121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.728070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 423/857] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:45.734316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.745288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf44de-b0b1-48cf-99b6-976966d3c604 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.750345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.751234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.751521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.751801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.763224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.765192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.783429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:45.785178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 435/858] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:45.791381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.801660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adb473-9908-43b5-ad9f-d472dd8e979b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.806431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.807158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.807496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.807776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.808564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.808930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.810586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.823655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 424/859] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.829800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.840772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72f90-d47e-4154-a9cf-64f5712ae19e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.845323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.846201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.846531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.846809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.854365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.856406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.869956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-2b98d923-24e0-4c5a-84ce-a772b540ad4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:45.871550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 436/860] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:45.878237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.888365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d7665-3737-44ec-9796-25f9a3ca1601 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.893005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.893669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.893954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.894232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.895038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.895362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.897082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7dd2-6d50-4f96-a463-4342cff8c396 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.897422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7dd2-6d50-4f96-a463-4342cff8c396 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.897699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7dd2-6d50-4f96-a463-4342cff8c396 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.899278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.899778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 437/861] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:45.906191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.906551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.906896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.916884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 425/862] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:45.925199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.926574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:45.927906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:45.935852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f042-c448-49b1-9ca4-61c58fd8a62a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.940868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 438/863] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:45 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:36:45.948882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.949611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.949906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.950187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.951097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2403ee720a14460c9eb69191acfda31a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:45.951416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.953301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:45.960761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 426/864] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/role_assignments?user.id=2403ee720a14460c9eb69191acfda31a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:45.972526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:45.981866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665e97a-8a1b-4464-a10d-610e9d24864a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:45.986173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:45.986973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:45.987250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:45.987518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] PATH_INFO: `/v3/services/network` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:45.992263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:45.994068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.011199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 25 04:36:46.012536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:45 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:46.019655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.033773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d06ff4-94e2-4116-8921-e94aa2c37dbf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.038225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.038893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.039237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.039439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.040170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] RBAC: Adding query filter params (name=network) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:46.040470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.042417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.053011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 427/866] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:46 2021] GET /identity/v3/services?name=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:46.059463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.069781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cd90d-3874-4f1b-b3f1-440e9d1d1f3b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.074649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.075352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.075630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.075908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.081046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:46.081350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.083040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd89e5-dcc7-4d1d-8367-28a42210c7a2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.089400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 440/867] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:46 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:46.095644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.106041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f865f2-f8e8-4f61-977c-65a0473f4f6a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.110805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.111494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.111770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.112040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.112878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.114501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f79d49-a33b-46a3-82b3-faeb0479331e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.143018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 428/868] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:36:46 2021] POST /identity/v3/endpoints => generated 327 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:46.691136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522a69-fb5e-45b6-a214-5cc176eabd23 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.691510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522a69-fb5e-45b6-a214-5cc176eabd23 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.691687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522a69-fb5e-45b6-a214-5cc176eabd23 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.693734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 441/869] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:46.699614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.699903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.700194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.720463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:46.721653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:46.739317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 429/870] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:46 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:46.762829 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522a69-fb5e-45b6-a214-5cc176eabd23 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.775286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522a69-fb5e-45b6-a214-5cc176eabd23 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.779540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.780374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.780653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.780921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.781588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.783256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.794992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 25 04:36:46.796496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 442/871] 10.222.0.36 () {56 vars in 1153 bytes} [Thu Nov 25 04:36:46 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:46.802964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.812673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05117a9-4245-4c4f-a0a6-79427e8dc0f3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.817248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.817958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.818235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.818505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.819314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:46.819574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.821172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955cae5-a6ff-4201-9c8b-1e4b9330622b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.826625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 430/872] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:46 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:46.832703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:46.842609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b277d6-826d-41b3-a496-d8ca733d21bf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:46.846972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:46.847634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:46.847913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:46.848208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:46.848945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:46.849299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:46.850915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dc6dd-c9e4-4432-93d4-85ab8b54b845 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:46.856459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 443/873] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:46 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:47.456472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e0ad-0cde-4609-8ed2-a52939324ca4 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.456472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e0ad-0cde-4609-8ed2-a52939324ca4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.456472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e0ad-0cde-4609-8ed2-a52939324ca4 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.457697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 431/874] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:47.464035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.464912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.465408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.483389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:47.484928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:47.492777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 444/875] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:47 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:47.520940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e0ad-0cde-4609-8ed2-a52939324ca4 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.533627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e0ad-0cde-4609-8ed2-a52939324ca4 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.538227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.539250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.539747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.540282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.551401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:47.558673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:36:47.570303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 432/876] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:47.573282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.587991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e1da-ad13-4526-bb04-1d094e06ab38 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.592935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.593919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.594402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.594949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.595983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:47.596521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.598397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.611589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 445/877] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:47.618302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.630174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4cb64-24ae-4ba9-ae3b-d11c01b12948 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.635015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.636172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.636675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.637169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.648789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.650956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.667551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:47.669414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 433/878] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:47.675838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.686254 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9513e-6c8b-4ec5-8a22-991ed319e4cd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.691126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.692044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.692496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.692940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.693834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:47.694293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.696033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.709201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 446/879] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:47.715607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.726049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc88a8-1817-4269-85c7-9d9f36cb7237 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.731119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.732233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.732689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.733139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.742081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.744398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.758964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 25 04:36:47.760830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 434/880] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:47.767207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.777471 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48cf4-ecbf-4769-878e-a28eadb62230 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.782247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.783108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.783532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.783957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.785151 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:47.785601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.787669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.805866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 447/881] 10.222.0.36 () {56 vars in 1156 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:47.812299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.822884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c05e-c5fb-41e5-910f-5f908155f8f9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.827922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.828873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.829335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.829750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.839104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.841368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.852224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 435/882] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:47.858838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.869836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d865-6b1d-403e-9581-378f93fcd49d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.874902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.875872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.876344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.876788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.887423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.889515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.906329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:47.908049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 448/883] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:47.914279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.923669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195e83-9c94-433e-94f4-96bc47168df2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.928470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.929333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.929762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.930199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.931077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:47.931529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.933466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.946631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 436/884] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:47.953405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:47.963672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439e3ff-3a9e-454b-a5bb-ce95bf2753ff admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:47.968537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:47.969583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:47.970076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:47.970566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:47.977835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:47.980267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:47.993548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:47.995470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 449/885] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:48.002278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.012693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fbe53-2875-473a-8849-64f61ee0e506 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.017525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.018507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.019056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.019546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.020580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.021083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.023164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb19c1-aabb-4620-85ee-2feeda6d4604 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.036025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 437/886] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.043399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.055082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5850bf-8e49-47fc-913d-e78236d1a846 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.060092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.061007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.061490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.061986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.063050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.063586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.065815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3746e-92df-45fa-beaf-daf6e373f529 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.073428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 450/887] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/role_assignments?user.id=86de70eda88d4d4ea1fdd4bc96bc6ff8&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.239565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5acd-aa3a-47b3-a58b-7848d63795db None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.239744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5acd-aa3a-47b3-a58b-7848d63795db None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.240023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5acd-aa3a-47b3-a58b-7848d63795db None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.242383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 438/888] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:48.249585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.249923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.250143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.268955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:48.270233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:48.284335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 451/889] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:48 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:48.302452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5acd-aa3a-47b3-a58b-7848d63795db None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.315952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a5acd-aa3a-47b3-a58b-7848d63795db None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.320661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.321459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.321743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.322018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.322759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.324396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.336313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 25 04:36:48.337835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 439/890] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:48.344707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.354882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e3afd-09be-4a19-98c4-dceb871223a7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.359670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.360602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.361086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.361580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.362512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.363042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.364935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be606c-5baf-43ee-bfbf-2d1d53b066eb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.370548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 452/891] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.376845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.387168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ab7f-7c9d-47d9-b5e0-d727c7152dac admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.392032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.393028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.393512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.394031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.394956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.395458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.397281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08bc99-9f4c-4411-a8da-ba26b8a095c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.403065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 440/892] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.707579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138fd9b-e657-46c9-9be1-876d94646c64 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.708077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138fd9b-e657-46c9-9be1-876d94646c64 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.708204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138fd9b-e657-46c9-9be1-876d94646c64 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.710168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 453/893] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:48.716465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.716894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.717086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.734955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:48.736168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:48.744114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 441/894] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:48 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:48.769643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138fd9b-e657-46c9-9be1-876d94646c64 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.782208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138fd9b-e657-46c9-9be1-876d94646c64 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.786525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.787356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.787644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.787916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.798552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:48.805920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:36:48.807536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 454/895] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:48.814105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.823227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4dbc7-51f3-41a0-be6e-92c7ec9db804 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.827790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.828552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.828836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.829112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.829954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.830274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.831855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.840951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 442/896] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.846923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.857501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708eff5f-46e1-4954-b4b5-81559a28e113 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.862120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.862896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.863175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.863445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.881051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.883337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.902349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:48.904525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 455/897] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:48.910699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.923071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b09be-5ead-451b-809c-11a03dc0bb07 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.929918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.930636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.930919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.931194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.932019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:48.932354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.933956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.946799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 443/898] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:48.953094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:48.963141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328aa1-f95d-4294-81e8-6ad0d36acec2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:48.967839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:48.968813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:48.969097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:48.969368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:48.977044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:48.979507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:48.994109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:48.995658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 456/899] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:48 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:49.002300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.012441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ab1a-f6c5-4632-9b76-60742e254a18 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.017116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.017830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.018120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.018390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.019276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:49.019590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.021556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.040054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 444/900] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:49.046443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.056556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efc825-299d-43ba-a8c5-e17c49125131 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.061258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.061961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.062300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.062578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.070743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.072738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.082320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 457/901] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:49.088536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.098716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89722d6-fd06-4609-8bb2-0c9a7404cf52 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.103240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.104122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.104478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.104756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.115522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.117479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.135508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:49.137157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 445/902] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:49.143352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.152504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15c89a-8c19-4303-bd1f-fa28706f4531 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.157188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.157900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.158178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.158449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.159242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:49.159553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.161439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.174024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 458/903] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:49.180070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.190763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94239d8-2327-4dc1-a67c-be1cef5193c9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.195656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.196795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.197325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.197951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.205661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.207990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.222414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:49.228140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 446/904] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:49.230987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.241926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379371ea-0cf3-4f10-b5b3-77e15d368537 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.246854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.248181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.248787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.249281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.250331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:49.250836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.252914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec36da-d37c-41bf-afc7-d9e8ea5197d6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.266546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 459/905] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:49.272991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.283659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95797b-d005-474c-8297-0a976c6853f9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.288378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.289024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.289301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.289569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.290411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] RBAC: Adding query filter params (role.id=5090dc8665a44bdf813cd724a9428acf, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2403ee720a14460c9eb69191acfda31a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:49.290708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.292778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e701-2ecd-430f-8e44-ff0644cecb03 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.299137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 447/906] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:49 2021] GET /identity/v3/role_assignments?user.id=2403ee720a14460c9eb69191acfda31a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5090dc8665a44bdf813cd724a9428acf => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:49.326575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e2a7-411a-4795-8011-65d420a0df20 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.327226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e2a7-411a-4795-8011-65d420a0df20 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.327705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e2a7-411a-4795-8011-65d420a0df20 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.330213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 460/907] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:49.337022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f83-b507-4d48-91a6-5ac703d1274f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.337663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f83-b507-4d48-91a6-5ac703d1274f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.338168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59f83-b507-4d48-91a6-5ac703d1274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.357591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-05e59f83-b507-4d48-91a6-5ac703d1274f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:49.359185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-05e59f83-b507-4d48-91a6-5ac703d1274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:49.367966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 448/908] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:49 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:49.392646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e2a7-411a-4795-8011-65d420a0df20 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:49.406420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e2a7-411a-4795-8011-65d420a0df20 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:49.411680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:49.412772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:49.413305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:49.413804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:49.414851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:49.416089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:49.416089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:49.416089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:49.417746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec8d9-aa94-461e-8259-d064987f71ee admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:49.436395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 461/909] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:36:49 2021] POST /identity/v3/services => generated 269 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:50.610134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fe80-90c1-444b-ac46-f65ab83dd6b7 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.610670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fe80-90c1-444b-ac46-f65ab83dd6b7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.610670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fe80-90c1-444b-ac46-f65ab83dd6b7 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.612808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 449/910] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:50.619116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.619570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.619761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.639440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:50.640718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:50.664266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 462/911] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:50 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:50.682427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171fe80-90c1-444b-ac46-f65ab83dd6b7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:50.694824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171fe80-90c1-444b-ac46-f65ab83dd6b7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:50.699330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:50.700188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.700471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.700753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.701439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:50.703063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:50.714456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 25 04:36:50.720253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 450/912] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:50 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:50.722825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:50.731946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb502510-db92-47fe-ab24-91eb70da2730 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:50.736555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:50.737246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.737531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.737811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.738565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:50.738873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:50.740512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7bcb-5b12-4aec-bf1e-00888d845741 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:50.749724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 463/913] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:50 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:50.752876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:50.762958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391b733-c366-41e5-ab5a-07df5755f507 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:50.767551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:50.768274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.768562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.768838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.769593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:50.769903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:50.771521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea48aad-ee52-43ca-8c9a-7598d0ebbb6a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:50.780265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 451/914] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:50 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:50.879850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bbdce-fe36-48a1-88e6-e1d84017add9 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.880179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bbdce-fe36-48a1-88e6-e1d84017add9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.880361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bbdce-fe36-48a1-88e6-e1d84017add9 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.882515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 464/915] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:50.889121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e0b7-806d-4dd4-b84b-fe7ba87ac051 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.889396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e0b7-806d-4dd4-b84b-fe7ba87ac051 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.889681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e0b7-806d-4dd4-b84b-fe7ba87ac051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.909019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6d13e0b7-806d-4dd4-b84b-fe7ba87ac051 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:50.910254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6d13e0b7-806d-4dd4-b84b-fe7ba87ac051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:50.918778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 452/916] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:50 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:50.942493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bbdce-fe36-48a1-88e6-e1d84017add9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:50.955623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bbdce-fe36-48a1-88e6-e1d84017add9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:50.960241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:50.960984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:50.961263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:50.961543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:50.962397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:50.964206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2759676-cf7a-496e-8895-53bfcf62544b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:50.984119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 465/917] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:36:50 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:51.682584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f71f-15f9-429c-a2b7-ea969cf56e2a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.683300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f71f-15f9-429c-a2b7-ea969cf56e2a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.683300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f71f-15f9-429c-a2b7-ea969cf56e2a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.685187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 453/918] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:51.691099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.691574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.691724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.709321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:51.710504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:51.727614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 466/919] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:51 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:51.751355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6f71f-15f9-429c-a2b7-ea969cf56e2a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.764257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6f71f-15f9-429c-a2b7-ea969cf56e2a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.768643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.769449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.769727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.769997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.780838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:51.788039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:36:51.789587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 454/920] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:51.796061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.805019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028c5db-dc84-4ee3-b722-b8ca3b4deb8c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.809658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.810334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.810611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.810880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.811638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:51.811938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:51.813545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:51.822336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 467/921] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:51.828386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.838521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c08da-44ed-4d91-9158-9058b61f9021 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.843123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.843937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.844241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.844519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.856317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:51.858163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:51.875348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:51.876960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 455/922] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:51.883179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.893034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9ca7-04c4-4a15-9fe0-4c98e40fcba7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.897549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.898210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.898487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.898757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.899505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:51.899810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:51.901716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1d114-0a6f-4176-a30b-4a18757e2012 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:51.914096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 468/923] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:51.920105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.928322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cfb3-be00-4c33-885f-fb3cc59592c8 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.928322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cfb3-be00-4c33-885f-fb3cc59592c8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.928322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cfb3-be00-4c33-885f-fb3cc59592c8 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.928322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 469/924] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:36:51.930178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab955a39-0c37-4d6c-92a7-ac0e04c549e6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.936490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.936786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.937207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.938345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.939372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.939831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.940311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.950404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:51.952795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:51.956380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:51.957582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:51.971899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 470/925] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:51 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:51.972078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:51.972211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 456/926] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:51.978257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.987962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0098ce-d71c-47e5-a2aa-297af614cd89 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:51.992766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:51.993479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:51.993765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:51.994090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:51.995808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:51.996515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:51.997027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:51.999376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.008345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0faad-58ba-4e1f-9a27-3a806b4cbd5e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.017603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.018495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 471/927] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:52.023648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.023648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.023648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.023648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.023648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.024980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.034780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a20c9-64fe-4665-91a2-2935ec5417c2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.037808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 25 04:36:52.044172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 457/928] 10.222.0.36 () {56 vars in 1153 bytes} [Thu Nov 25 04:36:51 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:52.044300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.044300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.044300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.044300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.049386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.054902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.057400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.060256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7cf85-379e-4ac7-871c-d93b2fd670d1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.065196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.066141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.066610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.067121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.068090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:52.068619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.070462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.080250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:52.080250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 472/929] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:52.080874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 458/930] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:52.083697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.084741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.094942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f97e-c6e5-4eb6-90af-fcc2d260de2e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.099788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.100487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.100766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.101084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.101832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:52.102180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.102627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4114c-ad7b-4921-be8d-2cdcfe97cd0b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.103937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.108837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.109773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.110274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.110743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.112183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:52.112712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.115244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.121805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 459/931] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:52.124330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.126030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 473/932] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:52.132333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.135413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346aaa-65fe-4c6d-994e-ac29da5b014b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.141257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.142069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.142408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.142679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.145229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c393ea-5061-4c5e-9b3a-df9e8a4be0ea admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.150583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.150872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.151795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.152448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.152930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.153045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.154250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] RBAC: Adding query filter params (interface=public, service_id=5d4fda8b593f4073b987413335546494, region_id=RegionOne) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:52.154938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.157072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.163362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 474/933] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/endpoints?service_id=5d4fda8b593f4073b987413335546494&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:52.168226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:52.168434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 460/934] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:52.173831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.174914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.184454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8bc5-0635-459e-8d22-8bea2a9a7702 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.187587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefffc13-6303-4158-b2ec-b0c8d88e6c4d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.189269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.190063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.190440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.190864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.191776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.193556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.193709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.194489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.195187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.195662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.197030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:52.197752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.199949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a813c-f7ee-4f69-890c-d9a47ae02ae3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.201428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 475/935] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:36:52.216838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 461/936] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:52.224042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:52.235230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec505b-3acb-454b-b732-24edd6154699 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:52.240385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:52.241654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:52.242149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:52.242596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2403ee720a14460c9eb69191acfda31a/roles/5090dc8665a44bdf813cd724a9428acf` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:52.245303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=2403ee720a14460c9eb69191acfda31a, role_id=5090dc8665a44bdf813cd724a9428acf)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:52.248646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddc88f-88f0-4a64-9b6c-a52dc46624a6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:52.265512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 476/937] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:36:52 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2403ee720a14460c9eb69191acfda31a/roles/5090dc8665a44bdf813cd724a9428acf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:36:53.182074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04167-405e-4da2-87f9-7acb456921e2 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.182634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04167-405e-4da2-87f9-7acb456921e2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.182634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04167-405e-4da2-87f9-7acb456921e2 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.184892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 462/938] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:53.191000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a674-5248-4832-ad74-8f2f210fc6cf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.191400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a674-5248-4832-ad74-8f2f210fc6cf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.191629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a674-5248-4832-ad74-8f2f210fc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.210794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6541a674-5248-4832-ad74-8f2f210fc6cf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:53.211992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6541a674-5248-4832-ad74-8f2f210fc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:53.276271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 477/939] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:53 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:53.295265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd04167-405e-4da2-87f9-7acb456921e2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.308006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd04167-405e-4da2-87f9-7acb456921e2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.312472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.313151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.313437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.313714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.314475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.316101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cdc63-50a7-45a1-bf55-1fcd6211d86c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.336295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 463/940] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:36:53 2021] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:53.445043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed509-668c-4cb9-9dbb-4624eda8ffde None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.445228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed509-668c-4cb9-9dbb-4624eda8ffde None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.445498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ed509-668c-4cb9-9dbb-4624eda8ffde None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.447640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 478/941] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:53.453849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.454190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.454414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.473427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:53.474665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:53.492711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 464/942] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:53 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:53.517833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ed509-668c-4cb9-9dbb-4624eda8ffde None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.533498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ed509-668c-4cb9-9dbb-4624eda8ffde None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.538197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.539114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.539393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.539717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.540451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.542361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.554584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 25 04:36:53.556229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 479/943] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:53 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:53.563201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.574253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce57a9c-0365-43f1-a0ff-9db550535cbd None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.582667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.583710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.583992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.584330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.585079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:53.585385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.586990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.595641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 465/944] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:53 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:53.601518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.611808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d2305-de1e-4ad4-ac99-d7c3ed43f949 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.618293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.618969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.619320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.619745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.621003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:53.621003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.622450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.629669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 480/945] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:53 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:53.636840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.646993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400066dc-d9a8-4a91-b9c6-efb6de5940dd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.651839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.652547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.652832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.653111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.653941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] RBAC: Adding query filter params (interface=public, service_id=2a9f41ef33cf438ca29bf52d5eb1a689, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:53.654267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.655873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70157b-5095-45e7-a969-0d6b574ff58a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.666753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 466/946] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:36:53 2021] GET /identity/v3/endpoints?service_id=2a9f41ef33cf438ca29bf52d5eb1a689&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:53.668196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:53.678033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c7722-656a-4bf3-94c1-7833f3c6d89f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:53.682911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:53.683644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:53.684018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:53.684340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:53.685098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:53.686681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1eaab5-b78f-4056-9def-50bf29585e7a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:53.700450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 481/947] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:36:53 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:36:54.640743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b5bd-9e53-4915-a32f-e9e874ec761b None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.641442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b5bd-9e53-4915-a32f-e9e874ec761b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.641442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7b5bd-9e53-4915-a32f-e9e874ec761b None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.643444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 467/948] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:54.649781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.650376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.650376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.671399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:54.672993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:54.682616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 482/949] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:54 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:54.706089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b5bd-9e53-4915-a32f-e9e874ec761b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.719335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7b5bd-9e53-4915-a32f-e9e874ec761b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.723907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.724752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.725032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.725305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.725975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.727558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:54.739110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 25 04:36:54.740617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 468/950] 10.222.0.36 () {56 vars in 1153 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:54.747193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.756643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bcfe0-63f8-402b-b2d0-af00c679bfcf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.761288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.761956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.762236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.762507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.763229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:54.763529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.765140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ed889-1a24-4b8b-ae6a-dcb79f8c5a99 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:54.770304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 483/951] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:54.776495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.786348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa317-25d6-4d9a-9279-9ebb8664bc8b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.791082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.791758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.792040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.792339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.793073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:54.793375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.794992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:54.798320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acca1f-c45d-4c01-bedc-31f93ba7478a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.798612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acca1f-c45d-4c01-bedc-31f93ba7478a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.798885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acca1f-c45d-4c01-bedc-31f93ba7478a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.800832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 469/953] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:54.800953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 484/953] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:54.809298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.810550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.810935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.811305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.819558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5511e0-7c9f-4fd7-8e33-5b8ad03843ad admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.824725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.825405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.825682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.826066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.826705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.828320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:54.830356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:54.831798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:54.840388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 485/954] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:54 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:54.852187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 470/955] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:36:54 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:54.866188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.876875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6200c-27a7-4b12-95ae-a8b1f6befa25 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.893441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.894435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.894777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.895152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.907918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:36:54.915714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:36:54.917574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 486/956] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:54.924460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.935291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42573b-477a-466c-b3a3-48443a3770cd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.939878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.940618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.940898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.941171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.941955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:54.942265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.943909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:54.954420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 471/957] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:54.961629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:54.972270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7ffd0-9fb1-4284-a896-e28784d5a6ca admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:54.976965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:54.977830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:54.978109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:54.978424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:54.990663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:54.992613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.011026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:55.012651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 487/958] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:55.019236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.034087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525984d2-d718-43e1-9920-000d2b91947a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.039276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.040393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.040853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.041409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.042371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:55.042849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.044746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.058107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 472/959] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:55.064655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.075282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0127-d055-4dc7-a683-dd213af22934 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.080328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.081560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.082067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.082565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.092285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.094571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.111212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 25 04:36:55.112928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 488/960] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:55.119121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.129692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1af63-4ac9-40ee-8794-73a0ca96ea7c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.134255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.135108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.135468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.135794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.136805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:55.137177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.139125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.158720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 473/961] 10.222.0.36 () {56 vars in 1170 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:55.165512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.177434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d39bf-1a78-43f7-b512-e81005f925ec admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.182218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.183025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.183452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.183868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.192436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.194329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.204728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 489/962] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:36:55.211502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.222403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c70f6-799a-4c5f-a771-0ddebb2c14ba admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.227469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.228453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.229211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.229629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.240752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.242796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.260687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:36:55.262401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 474/963] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:55.268524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.277976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70846b4-423e-4f7e-87e5-48086a21cb26 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.282736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.283562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.283987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.284443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.285332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:55.285778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.287483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.304435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 490/964] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:55.306577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.316764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48882ee-4a0e-4ca0-9114-6c23d766af7c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.321551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.322588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.323097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.323516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.331158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.333325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.346462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:55.348128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 475/965] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:36:55.354803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.364901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ccc54-084b-4690-8c20-580da3b6a980 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.369801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.370635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.372382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.373136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.374117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:55.374573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.376584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e18258-0546-46fe-aeb3-ca73b751d06f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.389329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 491/966] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:36:55.395941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.406742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f77e-fc90-4038-a756-5ff37a8f9517 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.412087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.413017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.413486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.413978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.415091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] RBAC: Adding query filter params (role.id=5090dc8665a44bdf813cd724a9428acf, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2403ee720a14460c9eb69191acfda31a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:55.415571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.417777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71801-9746-4c46-b78c-58283f888cba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:55.424864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 476/967] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/role_assignments?user.id=2403ee720a14460c9eb69191acfda31a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5090dc8665a44bdf813cd724a9428acf => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:55.903842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018508f-895f-4ebd-8dc7-bfa457c3d6f4 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.904399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018508f-895f-4ebd-8dc7-bfa457c3d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.904701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018508f-895f-4ebd-8dc7-bfa457c3d6f4 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.906962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 492/968] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:55.913108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.913567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.913645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.932492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:55.933805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:55.942154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 477/969] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:55 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:55.965556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018508f-895f-4ebd-8dc7-bfa457c3d6f4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:55.984252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018508f-895f-4ebd-8dc7-bfa457c3d6f4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:55.991904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:55.992757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:55.993029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:55.993297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:55.993972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:55.995729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.022094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 25 04:36:56.029323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 493/970] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:56.032072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.047135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef0ef7-2705-4667-a733-22828b16de55 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.052144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.053096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.053625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.054112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.055067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:56.055578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.057490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.063580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 478/971] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:56.069984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.079847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a637-9159-4ab5-8c1d-90ab7b806f62 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.084472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.085130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.085408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.085671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.086398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:56.086699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.088322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.093767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 494/972] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:56.100347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.110578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27480c0-2b19-4339-98c2-a8bdc9123d46 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.115076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.115728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.116006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.116307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.117111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] RBAC: Adding query filter params (interface=public, service_id=947a6f0331b34a259af86506b90925c4, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:56.117416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.118991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71398c95-1d65-46c6-a475-2b87d091ff3c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.125316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 479/973] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/endpoints?service_id=947a6f0331b34a259af86506b90925c4&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:56.131562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.141625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d49f9-26ec-4b0a-a2c3-24a9ac568d96 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.146112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.146790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.147070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.147338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.148051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.149708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c0997-c3f4-4633-9779-cab1e8ee1548 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.156926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 495/974] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:36:56.224725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3deb5-f2b5-48ab-a7f8-f453d8d791ce None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.225082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3deb5-f2b5-48ab-a7f8-f453d8d791ce None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.225294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3deb5-f2b5-48ab-a7f8-f453d8d791ce None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.227589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 480/975] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:56.234612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.234957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.235168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.254710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:56.255945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:56.268296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 496/976] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:56 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:56.289032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3deb5-f2b5-48ab-a7f8-f453d8d791ce None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.302444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3deb5-f2b5-48ab-a7f8-f453d8d791ce None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.307433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.308327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.308616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.308883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.309652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.311329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.323367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 25 04:36:56.330562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 481/977] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:56.332081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.341623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18551108-437d-4b6b-9f29-6e159e62df4a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.346477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.347226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.347512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.347842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.348634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:56.348948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.350633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.360302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 497/978] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:56.363089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.373925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c3e4-2935-45e1-be55-d99a23b49666 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.380811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.381506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.381806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.382077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.382812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:56.383119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.384816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b4da7-8196-4454-9a37-482f306dc46c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.395748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 482/979] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Nov 25 04:36:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:56.397302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:56.407382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773121b3-85b8-49f9-81d6-6ed4faf632af admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:56.412016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:56.412751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:56.413037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:56.413318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:56.414100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:56.415118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:36:56.415118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:36:56.415118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:36:56.416025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37b00a-d0ca-4569-9731-a161681cebeb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:56.448404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 498/980] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:36:56 2021] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:36:57.416368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9b29-357f-4dbd-9505-888954a6d473 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:57.416368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9b29-357f-4dbd-9505-888954a6d473 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:57.416368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd9b29-357f-4dbd-9505-888954a6d473 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:57.418047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 483/981] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:57.424100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:57.424565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:57.424673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:57.442912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:57.444087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:57.461276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 499/982] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:57 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:57.485615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9b29-357f-4dbd-9505-888954a6d473 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:57.498743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd9b29-357f-4dbd-9505-888954a6d473 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:57.503184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:57.503990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:57.504313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:57.504587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:57.505279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:57.506878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:57.518222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 25 04:36:57.519749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 484/983] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:57 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:57.526387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:57.535634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ad203-7993-45b8-a9bb-5b4d389f1012 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:57.540286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:57.540995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:57.541487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:57.541768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:57.542532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:57.542836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:57.544467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e486-24b2-428c-83a5-75a7e0766244 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:57.550846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 500/984] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:57 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:57.560323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:57.574350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435641e-f860-4b3d-bf46-15f7e5512724 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:57.578985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:57.579646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:57.579925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:57.580227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:57.580955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:57.581259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:57.582852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c797c0-14d6-47eb-8dae-0265edfe9fd4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:57.588256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 485/985] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:57 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:58.143208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b95f-535f-466e-ad42-b10ca71ff869 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.143602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b95f-535f-466e-ad42-b10ca71ff869 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.143813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61b95f-535f-466e-ad42-b10ca71ff869 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.145983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 501/986] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:58.151796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.152079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.152387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.170404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:58.171581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:58.179662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 486/987] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:58 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:58.204032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61b95f-535f-466e-ad42-b10ca71ff869 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.218920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61b95f-535f-466e-ad42-b10ca71ff869 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.223362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.224324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.224611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.224885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.225555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.227147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.238477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 25 04:36:58.239996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 502/988] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:58.246735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.257446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437d585-c5e7-4045-abca-77015ebc7fd0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.262593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.263269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.263548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.263816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.264571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] RBAC: Adding query filter params (name=image) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:58.264868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.266447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28746e-35fe-4419-aef8-6f8a35580d39 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.272094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 487/989] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:58.278328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.288444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9faca9-0f3f-4dc9-8693-196602b7dba5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.293209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.293913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.294195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.294481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.295312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:58.295630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.297362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce800-5f0e-4b78-8bc4-63e9bae2eda3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.302704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 503/990] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:58.611879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6702f-405f-484b-a141-080512008ca0 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.611879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6702f-405f-484b-a141-080512008ca0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.611879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6702f-405f-484b-a141-080512008ca0 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.613114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 488/991] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:58.619377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420302b8-9239-4dba-8604-667efa5a858a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.620342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420302b8-9239-4dba-8604-667efa5a858a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.620848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420302b8-9239-4dba-8604-667efa5a858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.639845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-420302b8-9239-4dba-8604-667efa5a858a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:58.641524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-420302b8-9239-4dba-8604-667efa5a858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:58.649803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 504/992] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:58 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:58.674107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6702f-405f-484b-a141-080512008ca0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.687459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6702f-405f-484b-a141-080512008ca0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.692237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.693381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.693964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.694438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.695319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.697134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.709533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 25 04:36:58.711511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 489/993] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:58.718697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420302b8-9239-4dba-8604-667efa5a858a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.728308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420302b8-9239-4dba-8604-667efa5a858a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.733255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.734219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.734691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.735208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.736173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:58.736674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.738516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.743909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 505/994] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:58.750864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.761726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c287-f5b9-418d-a006-6a7a6eeca20b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.766978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.768016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.768560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.769035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.770139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:58.770645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.772521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9fe4f-661d-4dd9-9dcc-3645a52368f1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.779278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 490/995] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:36:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:36:58.785876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:58.796073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130e57e-f54b-41d3-83de-64d99045595d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:58.801017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:58.801956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.802430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.802892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.803880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:58.805808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b6823-d4bd-485d-9395-29568761eb1c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:58.828434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 506/996] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:36:58 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:36:58.923682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8f68-0b2a-4c9c-aa7d-a1d975d8a4f3 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.924370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8f68-0b2a-4c9c-aa7d-a1d975d8a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.924866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8f68-0b2a-4c9c-aa7d-a1d975d8a4f3 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.927732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 491/997] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:36:58.934155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:58.934442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:58.934756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:58.953905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:36:58.955148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:36:58.973476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 507/998] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:36:58 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:36:58.999213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8f68-0b2a-4c9c-aa7d-a1d975d8a4f3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:59.012571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8f68-0b2a-4c9c-aa7d-a1d975d8a4f3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:59.017482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:59.018225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:59.018553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:59.018873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:59.019686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:59.021740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:59.023257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.common [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 25 04:36:59.044779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.sql.core [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 25 04:36:59.044779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 25 04:36:59.044779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [parameters: {'id': 'bc1621c293db4c2f9a2e0541900232cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 25 04:36:59.044779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 25 04:36:59.051706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc1621c293db4c2f9a2e0541900232cf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc1621c293db4c2f9a2e0541900232cf. Nov 25 04:36:59.053558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 492/999] 10.222.0.36 () {60 vars in 1161 bytes} [Thu Nov 25 04:36:58 2021] POST /identity/v3/projects => generated 262 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:59.060492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:59.070624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437055-7380-469c-955a-1e310bf0d1a7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:59.076817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:59.078058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:59.078672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:59.079193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:59.087144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:59.089587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:59.102564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-4376103a-29f0-42ee-97bd-0ef499dbbbf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:36:59.104369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 508/1000] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:36:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:36:59.113608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:36:59.126969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009e0-e9be-4ac5-9e66-84d33e356f9c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:36:59.132125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:36:59.133056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:36:59.133595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:36:59.134059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:36:59.135149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:36:59.135792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:36:59.138236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308c0a1-6aec-49b2-a54f-b0ffff1c968b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:36:59.161021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 493/1001] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:36:59 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:00.001163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066966-6a5c-4d00-ba0f-b0047eb21e74 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.001679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066966-6a5c-4d00-ba0f-b0047eb21e74 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.001679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066966-6a5c-4d00-ba0f-b0047eb21e74 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.003627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 509/1002] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:36:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:00.009886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06733b00-a440-462e-ae13-9282f3cf2fa7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.010320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06733b00-a440-462e-ae13-9282f3cf2fa7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.010514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06733b00-a440-462e-ae13-9282f3cf2fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.028981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-06733b00-a440-462e-ae13-9282f3cf2fa7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:00.030548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-06733b00-a440-462e-ae13-9282f3cf2fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:00.038686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 494/1003] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:00 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:00.062860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066966-6a5c-4d00-ba0f-b0047eb21e74 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:00.076212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066966-6a5c-4d00-ba0f-b0047eb21e74 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:00.080607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:00.081260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.081543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.081815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.082624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:00.084287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab394-9023-4dcf-8e26-9c0f66d4452c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:00.103120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 510/1004] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:37:00 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:00.760323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38309d-f82a-4b23-88b4-3fef8136b9d5 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.760697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38309d-f82a-4b23-88b4-3fef8136b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.760896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38309d-f82a-4b23-88b4-3fef8136b9d5 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.762946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 495/1005] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:00.768721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ab08-3ba6-4407-be6d-5715883525a0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.769012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ab08-3ba6-4407-be6d-5715883525a0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.769287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402ab08-3ba6-4407-be6d-5715883525a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.793223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c402ab08-3ba6-4407-be6d-5715883525a0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:00.794516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c402ab08-3ba6-4407-be6d-5715883525a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:00.811698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 511/1006] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:00 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:00.837241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38309d-f82a-4b23-88b4-3fef8136b9d5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:00.849813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38309d-f82a-4b23-88b4-3fef8136b9d5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:00.854433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:00.855097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:00.855380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:00.855658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:00.856452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:00.858051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d17bb-103a-4b38-ac20-6be4d94e751d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:00.874885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 496/1007] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:37:00 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:01.328314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbd1f-da95-4778-bbc6-7a2c0cd41b0b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.329345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbd1f-da95-4778-bbc6-7a2c0cd41b0b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.329830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbd1f-da95-4778-bbc6-7a2c0cd41b0b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.332111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 512/1008] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:01.338432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.339262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.339733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.357703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:01.359228 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:01.377174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 497/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:01 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:01.401401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbd1f-da95-4778-bbc6-7a2c0cd41b0b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.413937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbd1f-da95-4778-bbc6-7a2c0cd41b0b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.418609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.419671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.420144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.420643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.421507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.423277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.434944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 25 04:37:01.436644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 513/1010] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:01.443586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.452967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa0a9-50b7-4a92-bb96-8cc249b2a8c5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.457761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.458657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.459134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.459601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.460547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:01.461044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.462889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.468640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 498/1011] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:01.474948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.485843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572cb61-c786-4dbd-a9d7-1231044f6469 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.490690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.491590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.492074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.492590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.493509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:01.494057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.495839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.501782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 514/1012] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:01.508430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.518379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9a606-3fa4-4f13-ab9f-c92ee2dfb1a7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.523140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.524031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.524536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.525009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.526051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] RBAC: Adding query filter params (interface=admin, service_id=947a6f0331b34a259af86506b90925c4, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:01.526588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.528369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471feb-45e6-4213-b142-33db85f7004e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.535152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 499/1013] 10.222.0.36 () {56 vars in 1270 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/endpoints?service_id=947a6f0331b34a259af86506b90925c4&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:01.541749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.551668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae879-4e67-4eea-8999-7c555ac36807 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.556410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.557330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.557810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.558230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.559142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.560913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a237ad-c3b2-4b2f-801a-968ff0fd5796 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.573452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 515/1014] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:37:01.624252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693c36b-4eb7-4e65-8e14-f323bcece528 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.624443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693c36b-4eb7-4e65-8e14-f323bcece528 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.624720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693c36b-4eb7-4e65-8e14-f323bcece528 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.626951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 500/1015] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:01.633450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.634013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.634459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.654943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:01.656674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:01.665509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 516/1016] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:01 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:37:01.691870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693c36b-4eb7-4e65-8e14-f323bcece528 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.705483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693c36b-4eb7-4e65-8e14-f323bcece528 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.710105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.710831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.711106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.711380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.712145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.714644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.731098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.sql.core [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 25 04:37:01.731098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 25 04:37:01.731098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [parameters: {'user_id': '103cde0e5e1b4822a09a47f5535af731', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 25 04:37:01.731098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 25 04:37:01.739089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 25 04:37:01.744498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 501/1017] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:37:01 2021] POST /identity/v3/users => generated 160 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:01.748745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.759515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79028ef3-fea9-4527-b4b2-e684648847f4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.765318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.766241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.766516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.766830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.776723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.778963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.794814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-abd3b4ea-d8f8-4252-ad28-6645a681d481 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 25 04:37:01.796493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 517/1018] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:01.806221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:01.818348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ada48-3395-42ae-accd-b6071d2271d5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:01.825980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:01.826375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:01.826661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:01.826925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:01.827766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:01.828071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:01.830404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348487bd-bbba-4631-bbb8-a4cd65f9060f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:01.874649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 502/1019] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Nov 25 04:37:01 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:02.548817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128cbe-3824-4473-9ea2-a762b8e3d280 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.549404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128cbe-3824-4473-9ea2-a762b8e3d280 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.549404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128cbe-3824-4473-9ea2-a762b8e3d280 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.551388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 518/1020] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:02.557278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.557738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.557819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.577785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:02.579303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:02.588300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 503/1021] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:02 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:02.612470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128cbe-3824-4473-9ea2-a762b8e3d280 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:02.625674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58128cbe-3824-4473-9ea2-a762b8e3d280 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:02.630648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:02.631435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.631717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.631988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.632696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:02.634273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:02.645331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 25 04:37:02.646675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 519/1022] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:37:02 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:02.653295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:02.662270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1b52-898d-42ee-83bd-a99a147e4f10 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:02.667195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905e43-acad-4004-937e-735e48134461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:02.667846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905e43-acad-4004-937e-735e48134461 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.668105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905e43-acad-4004-937e-735e48134461 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.668462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79905e43-acad-4004-937e-735e48134461 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.669191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79905e43-acad-4004-937e-735e48134461 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:02.669498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79905e43-acad-4004-937e-735e48134461 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:02.671067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79905e43-acad-4004-937e-735e48134461 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:02.676355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 504/1023] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:37:02 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:02.682523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:02.693319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b52c-cce2-423e-a3bc-3a0935020077 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:02.698320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:02.699004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.699288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.699569 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.700343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:02.700652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:02.702272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:02.708192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 520/1024] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:37:02 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:02.715179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905e43-acad-4004-937e-735e48134461 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:02.725431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79905e43-acad-4004-937e-735e48134461 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:02.730572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:02.731342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.731683 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.732025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.732942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] RBAC: Adding query filter params (interface=public, service_id=60ad2161a31a44118c1cb50f03e3b0dc, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:02.733325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:02.735057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e192b1-99d3-43e6-a0fe-8dbfca70c23c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:02.741018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 505/1025] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:37:02 2021] GET /identity/v3/endpoints?service_id=60ad2161a31a44118c1cb50f03e3b0dc&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:02.747728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:02.757939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15482511-1abc-4e82-9e8d-ed42acb8ac2a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:02.762951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:02.763618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:02.763904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:02.764201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:02.764906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:02.766543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69fdbb-855c-4df2-936c-03185c76f92c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:02.774823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 521/1026] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:37:02 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:37:03.318328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1c7-7f91-470b-872b-805688f15bfd None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.318723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1c7-7f91-470b-872b-805688f15bfd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.318894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1c7-7f91-470b-872b-805688f15bfd None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.320757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 506/1027] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:03.326762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.327010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.327318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.345640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:03.346807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:03.355277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 522/1028] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:03 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:03.378560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da1c7-7f91-470b-872b-805688f15bfd None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:03.391824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da1c7-7f91-470b-872b-805688f15bfd None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:03.396690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:03.397475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.397761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.398040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.398728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:03.400409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:03.411592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 25 04:37:03.412976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 507/1029] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Nov 25 04:37:03 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:03.420001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:03.433996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff4344-01b5-4fe9-a7c4-2cc9ca960c97 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:03.438943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:03.439611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.439890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.440170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.440914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:03.441217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:03.442790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:03.448910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 523/1030] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:03.454358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:03.464954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0006d-ab42-49fc-956d-0737571732d3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:03.470686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:03.471343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.471618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.471860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.472655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] RBAC: Adding query filter params (type=image) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:03.472953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:03.474528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:03.480710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 508/1031] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:03.487260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:03.497845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18d2a9-92fe-43d3-8808-d5bb71dc4bb9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:03.502520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:03.503190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.503464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.503733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.504553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] RBAC: Adding query filter params (interface=public, service_id=2c754b8e32184fe3aea63cec59a8f264, region_id=RegionOne) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:03.504859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:03.506436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d7909-d70d-48b4-acdc-503c73e11b6c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:03.512130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 524/1032] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:37:03 2021] GET /identity/v3/endpoints?service_id=2c754b8e32184fe3aea63cec59a8f264&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:03.518166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:03.528438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1cbbe-8b8e-445d-8e59-5942facfb7f0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:03.533780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:03.534423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:03.534702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:03.534972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:03.535667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:03.537451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2ec28-a7dd-4323-93e9-2b3993ebc8c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:03.545754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 509/1033] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:37:03 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:37:04.025035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557a042-e99c-4a0a-bb72-6c8e5aa5067b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.025660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557a042-e99c-4a0a-bb72-6c8e5aa5067b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.025660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557a042-e99c-4a0a-bb72-6c8e5aa5067b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.027791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 525/1034] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:04.033740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.034214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.034303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.052589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:04.053775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:04.062217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 510/1035] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:04 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:04.086122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557a042-e99c-4a0a-bb72-6c8e5aa5067b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:04.099281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557a042-e99c-4a0a-bb72-6c8e5aa5067b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:04.104184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:04.105088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.105369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.105650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.106351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:04.108004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:04.119518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 25 04:37:04.120867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 526/1036] 10.222.0.36 () {56 vars in 1147 bytes} [Thu Nov 25 04:37:04 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:04.127922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:04.137571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872bf4a-cdbd-468c-9c1a-36549f3feca5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:04.142464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:04.143222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.143581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.143923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.144766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:04.145144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:04.146785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:04.152384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 511/1037] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:37:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:04.158970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:04.169288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a403e8b-6faf-419e-a1fb-096c29638c22 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:04.174312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:04.174972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.175256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.175528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.176286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:04.176594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:04.178197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dd4d4-3f86-49bc-bfb5-b27c48317ef5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:04.183694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 527/1038] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Nov 25 04:37:04 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:04.190766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:04.201408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc9c7-2a86-412a-93a1-66ae14696b29 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:04.207266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:04.208012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:04.208406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:04.208753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:04.209595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:04.211278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da26ca0-eae0-4a13-96f4-cc1a64e02bdd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:04.228636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 512/1039] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:37:04 2021] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:05.148909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c658-eb69-48be-86d0-1e43139d6c1e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.149470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c658-eb69-48be-86d0-1e43139d6c1e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.149470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c658-eb69-48be-86d0-1e43139d6c1e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.151269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 528/1040] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:05.157434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.157880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.157967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.176323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:05.177518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:05.195416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 513/1041] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:05 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:05.219960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c658-eb69-48be-86d0-1e43139d6c1e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:05.232688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c658-eb69-48be-86d0-1e43139d6c1e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:05.237280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:05.238231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.238515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.238787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.239643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:05.241278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:05.253324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 25 04:37:05.254666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 529/1042] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:37:05 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:05.261171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:05.270426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8b484-4f04-4c40-a18e-6af7f18c1f75 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:05.276549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:05.277209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.277478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.277739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.278462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:05.278764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:05.280404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:05.285872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 514/1043] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:37:05 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:05.292063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:05.302178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be0fb-9237-4491-b613-f672bdba06c3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:05.306682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:05.307329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.307609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.307880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.308638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:05.308942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:05.310505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668fc34-11ca-4c71-b50d-4d62cdc9338c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:05.315775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 530/1044] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Nov 25 04:37:05 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:05.321769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:05.331413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0607af-5aa9-4ef0-b92a-5c77f222cb0a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:05.335842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:05.336526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.336815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.337073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.337891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:05.339637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1d75-0f08-47a8-9153-7ad82e881a0c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:05.359529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 515/1045] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:37:05 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:05.936328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a18e5-ca68-4916-aced-b29a26c9b65e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.936533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a18e5-ca68-4916-aced-b29a26c9b65e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.936797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a18e5-ca68-4916-aced-b29a26c9b65e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.938573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 531/1046] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:05.944929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:05.945228 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:05.945503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:05.963934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:05.965157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:05.984243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 516/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:05 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:06.007135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a18e5-ca68-4916-aced-b29a26c9b65e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.020913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a18e5-ca68-4916-aced-b29a26c9b65e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.025756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.026549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.026794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.027093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] PATH_INFO: `/v3/services/image` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.027771 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.029428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.040183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 25 04:37:06.041665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 532/1048] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Nov 25 04:37:06 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:06.048089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.057571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae930eef-fbdb-4587-8903-de0a3ffbf122 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.062419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.063198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.063551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.063897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.064746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:06.065123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.066813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.072122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 517/1049] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:06 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:06.078470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.088689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282788c-1e2c-4f53-a818-7be3b9445f21 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.093534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.094185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.094470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.094725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.095467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] RBAC: Adding query filter params (type=image) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:06.095774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.097420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58dc2d-3e6a-491a-9da2-859a7d46bf24 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.102625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 533/1050] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:06 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:06.108978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.119287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa531f-b5a1-4412-b30b-190247d67ab5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.124580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.125240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.125522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.125796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.126558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.128218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1244e4-9529-487b-b0b4-2b857eccd4f6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.149111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 518/1051] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:37:06 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:06.622667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ef21-d44b-4351-bbf8-743c8414ca70 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.623222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ef21-d44b-4351-bbf8-743c8414ca70 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.623222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10ef21-d44b-4351-bbf8-743c8414ca70 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.625326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 534/1052] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:06.631781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.632407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.632407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.651121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:06.652357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:06.670584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 519/1053] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:06.695238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10ef21-d44b-4351-bbf8-743c8414ca70 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.708311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10ef21-d44b-4351-bbf8-743c8414ca70 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.713039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.713833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.714116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.714394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.715664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.717398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760dd2-83c7-4cf4-b384-dcbf25ab8438 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.719004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 535/1054] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:06.725495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:06.734993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003328a3-87a2-41ec-bb4f-18df1bb554bb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:06.739907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:06.740600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:06.740885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:06.741159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:06.742074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:06.744046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d16bc-cc37-440c-b58f-ba5518e6e54b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:06.780222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 520/1055] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:37:06 2021] POST /identity/v3/projects => generated 311 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:07.828629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff3ad-86b0-414f-a7f1-edd329f6cb89 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:07.829219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff3ad-86b0-414f-a7f1-edd329f6cb89 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:07.829219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bff3ad-86b0-414f-a7f1-edd329f6cb89 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:07.830809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 536/1056] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:07.837104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:07.837578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:07.837708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:07.856325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:07.857505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:07.917837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 521/1057] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:07.942641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bff3ad-86b0-414f-a7f1-edd329f6cb89 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:07.957105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bff3ad-86b0-414f-a7f1-edd329f6cb89 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:07.962009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:07.962837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:07.963119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:07.963396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:07.974834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:07.982716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:37:07.984137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 537/1058] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:37:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:07.990724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.000903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e93d-233c-41a4-92b8-bddf6510d496 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.006017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.006676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.006960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.007200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.007977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.008317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.010406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.019334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 522/1059] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:37:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:08.025458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.035601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b7c9-fc23-48ca-b5c4-9d0038fe1bc3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.040596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.041653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.042002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.042340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.053373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.055210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.072267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:08.073620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 538/1060] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:08.079986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.090103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878231cf-595c-4fc9-9aa9-fcaa47b3f127 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.095521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.096173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.096503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.096722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.097476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.097776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.099357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.112020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 523/1061] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:08.118253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.128720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46c66-dec8-4578-9794-b237e0564943 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.133716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.134554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.134806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.135102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.143561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.145611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.161589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:37:08.163175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 539/1062] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:08.170140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.180184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafa0d-c184-4f64-bbfc-1e28be1475a2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.185429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.186083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.186361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.186591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.187458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.187760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.189609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.207162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 524/1063] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:08.213611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.223586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14232-1199-4063-9eee-6fb3f881bb2b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.228288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.229003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.229285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.229554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.237389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.239129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.248945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 540/1064] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:08.255289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.265373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4abc-9b21-4855-9e3d-21408b530e85 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.270200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.270957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.271263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.271503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.281743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.283579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.299767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:08.301105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 525/1065] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:37:08.307343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.316713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428ef8-cd30-46ca-8a54-38436792fd57 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.321657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.322399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.322821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.323173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.323993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.324394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.326080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.339452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 541/1066] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:08.344856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.354624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05889084-a2f3-42bc-ae20-f9cba4256244 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.358994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.359776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.360053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.360352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.366978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.369025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.381854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:37:08.383177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 526/1067] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:08.389528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.399873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf3f37-0675-4d08-90c4-b37cb91e4a22 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.405183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.405923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.406278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.406642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.407529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.407913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.409909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0d59-61a9-4b65-babb-e5ae8450497a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.423564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 542/1068] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:08.430121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.441189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92596764-1adb-48e7-989e-8d82187fde86 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.446851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.447552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.447846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.448120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.449021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] RBAC: Adding query filter params (role.id=5090dc8665a44bdf813cd724a9428acf, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:08.449335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.451207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02abb-718c-482b-93e0-baad6689202d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.457141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 527/1069] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5090dc8665a44bdf813cd724a9428acf => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:08.552048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0ee4-f349-4062-b4b0-8d7331d031cf None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.552442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0ee4-f349-4062-b4b0-8d7331d031cf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.552619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0ee4-f349-4062-b4b0-8d7331d031cf None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.554694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 543/1070] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:08.561174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.561514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.561710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.584018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:08.585294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:08.600289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 528/1071] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:08.617629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0ee4-f349-4062-b4b0-8d7331d031cf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.630980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0ee4-f349-4062-b4b0-8d7331d031cf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.636194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.636848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.637181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.637456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.646786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.648596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2f7a-ff03-42da-9f45-988531797cb2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.658711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 544/1072] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:08.665652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:08.675749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1007cf-39cc-4983-ac8c-a84bd5c653d0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:08.680751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:08.681564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:08.681846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:08.682113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:08.683985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:08.685692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c1b35-7271-4435-93ef-903fa8935e2e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:08.687393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 529/1073] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:09.182229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a65c3-17f7-4207-a009-65a502bc4d78 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:09.182810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a65c3-17f7-4207-a009-65a502bc4d78 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:09.182810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a65c3-17f7-4207-a009-65a502bc4d78 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:09.184553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 545/1074] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:09.190548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:09.191003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:09.191093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:09.209745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:09.210951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:09.220089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 530/1075] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:09.246316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a65c3-17f7-4207-a009-65a502bc4d78 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:09.260975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a65c3-17f7-4207-a009-65a502bc4d78 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:09.265859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:09.266656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:09.266939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:09.267216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:09.268459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:09.270143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e201a6b-a377-423e-80b6-e36eb7368f22 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:09.271700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 546/1076] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:09.278209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:09.287654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf5e12-f448-4e4a-b0ab-2ca8a4f968ea None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:09.292800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:09.293483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:09.293768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:09.294038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:09.294765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:09.296788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83334f06-c356-43dd-b94b-37850b0b683e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:09.319054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 531/1077] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:37:09 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:10.809318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba80ce-9038-447b-826c-965d999b429a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:10.809920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba80ce-9038-447b-826c-965d999b429a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:10.809920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba80ce-9038-447b-826c-965d999b429a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:10.811653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 547/1078] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:10.817784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:10.818186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:10.818335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:10.836781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:10.837964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:10.845995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 532/1079] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:10.869483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba80ce-9038-447b-826c-965d999b429a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:10.882816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba80ce-9038-447b-826c-965d999b429a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:10.888686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:10.889502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:10.889779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:10.890049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:10.901123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:10.908287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:37:10.909452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 548/1080] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:37:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:10.915594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:10.925405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9fb2b-14dd-49cb-ba1b-719a31e074c8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:10.930316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:10.930982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:10.931316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:10.931589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:10.932543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:10.932854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:10.934467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:10.943078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 533/1081] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:37:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:10.949298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:10.959998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7369db-3334-4bcb-a672-6e3488933d5a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:10.966188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:10.966971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:10.967249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:10.967511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:10.979218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:10.981080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:10.999053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:11.000318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 549/1082] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:11.006912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.017513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd13ec3-a126-47dd-a734-fe1ebb2348f2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.023323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.024004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.024315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.024588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.025346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:11.025800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.027430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.039740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 534/1083] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:11.046296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.056718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac82f-5e7e-47d6-81da-7c50ba75920a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.062546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.063324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.063603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.063871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.072021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.074075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.088659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:37:11.089750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 550/1084] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:11.096209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.106816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826374-2a0d-4a8e-8679-3993c32fd770 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.112719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.113400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.113682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.113962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.114816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:11.115122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.116997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.135938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 535/1085] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:11.142359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.152672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6239-ca4a-422f-ae86-cfb41a1a1215 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.158429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.159232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.159508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.159780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.171144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.173034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.190475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:11.191636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 551/1086] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:11.198444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.209227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4af2d5-7a5e-4f73-bdc6-5568def317ac admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.214528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.215194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.215479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.215751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.216531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:11.216836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.218467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.230465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 536/1087] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:11.236919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.246881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22346bf-66f4-4c33-adb2-f0ba5bf3eebb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.252522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.253306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.253590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.253840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.261136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.263091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.276078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:37:11.277263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 552/1088] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:11.283678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.293688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65546-7fbb-42ac-a9f2-82e07e896f7c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.298771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.299584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.299868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.300169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.301011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:11.301344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.303276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fc12-eda0-4d44-9177-0e3ff96ae668 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.317242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 537/1089] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:11.324207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.336620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d658-eddc-4a6b-87fd-e06b83f4aec0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.342649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.343479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.343756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.344025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/5090dc8665a44bdf813cd724a9428acf` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.346750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=2a5832639148459ca8895ae9e26e4b1a, role_id=5090dc8665a44bdf813cd724a9428acf)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.349392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bc304-a115-49d2-b024-a6ae4abc990d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.363559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 553/1090] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:37:11 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/2a5832639148459ca8895ae9e26e4b1a/roles/5090dc8665a44bdf813cd724a9428acf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:37:11.711967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883c89e-2bb3-441d-a251-a88d6615e865 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.712196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883c89e-2bb3-441d-a251-a88d6615e865 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.712509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883c89e-2bb3-441d-a251-a88d6615e865 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.714741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 538/1091] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:11.721183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.721540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.721820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.739683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:11.740902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:11.803421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 554/1092] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:37:11.828318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883c89e-2bb3-441d-a251-a88d6615e865 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.842534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883c89e-2bb3-441d-a251-a88d6615e865 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.847744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.848579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.848851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.849118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.860324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:11.866961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:11.868110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 539/1093] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:11.875160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.884266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a6bb9-4497-4b29-a0eb-95b8a24a8ee7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.889685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.890361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.890634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.890911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.891683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:11.891984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.893611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.902615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 555/1094] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:11.908651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.919482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65db4b-e147-4eea-b61f-c2ec396d4bbd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.924695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.925542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.925823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.926107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] PATH_INFO: `/v3/users/8737012e7c4f40dfa7ff6e92c31357df` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.939900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] RBAC: Authorizing `identity:get_user(user_id=8737012e7c4f40dfa7ff6e92c31357df)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.942077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.943733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 540/1095] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/users/8737012e7c4f40dfa7ff6e92c31357df => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:11.949968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:11.959618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07689f-1d53-4ed6-8df1-6a210ec58dcc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:11.965032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:11.965672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:11.966016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:11.966290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:11.973849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:11.975575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:11.984790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 556/1096] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:11.990985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:12.001307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5d12b-1400-4a5d-b83c-eb2ecd9b189c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:12.007130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:12.007967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:12.008278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:12.008549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:12.009907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:12.011922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7d0ed-b0fa-47ff-a951-79f9d32700bd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:12.013645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 541/1097] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:11 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:12.020191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:12.030039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446b705-a4c2-467f-b58e-f5e145716682 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:12.035682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:12.036339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:12.036631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:12.036897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:12.037734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=399b39f4ec5d47f0a014cd8baf0872be, user.id=8737012e7c4f40dfa7ff6e92c31357df) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:12.038037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:12.039860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a17ed6-ad0a-47f7-a38a-3db43858836a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:12.045717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 557/1098] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:12 2021] GET /identity/v3/role_assignments?user.id=8737012e7c4f40dfa7ff6e92c31357df&scope.project.id=399b39f4ec5d47f0a014cd8baf0872be&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:13.724627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d5c-21a2-43cb-a87e-5cc524f172e9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.725203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d5c-21a2-43cb-a87e-5cc524f172e9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.725203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d5c-21a2-43cb-a87e-5cc524f172e9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.727120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 542/1099] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:13.732998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.733440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.733540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.752645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:13.753831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:13.762727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 558/1100] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:13.788335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d5c-21a2-43cb-a87e-5cc524f172e9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:13.809459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d5c-21a2-43cb-a87e-5cc524f172e9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:13.814620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:13.815414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.815712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.815971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.827577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:13.834738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 25 04:37:13.836199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 543/1101] 10.222.0.36 () {56 vars in 1141 bytes} [Thu Nov 25 04:37:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:13.842867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:13.852101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7d3b2-e185-4456-b0cc-eed98e2c33ce None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:13.858117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:13.858878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.859221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.859553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.860413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:13.860793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:13.862367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:13.870759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 559/1102] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:37:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:13.877445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:13.888026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8de3-c43c-4811-ab7a-4c6a08ef2fd6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:13.893025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:13.893799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.894081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.894353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.904864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:13.906693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:13.924361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:13.925555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 544/1103] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:13.931912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:13.941960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687f620-9251-4bae-81f6-73fa74f95819 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:13.946724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:13.947467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.947750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.948024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.948805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:13.949108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:13.950733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:13.964584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 560/1104] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:13.971426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:13.982373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2478b3b-cfaf-44b6-a32b-865a93dd6ee7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:13.986982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:13.987798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:13.988079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:13.988379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:13.996565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:13.998930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.013514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 25 04:37:14.014707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 545/1105] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Nov 25 04:37:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:14.021328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.031252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991309d-294e-4a4f-afdf-93c60cd5639a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.035994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.036785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.037072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.037343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.038206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:14.038513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.040373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.058267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 561/1106] 10.222.0.36 () {56 vars in 1154 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.064608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.074926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8186-34b5-4697-82e0-b31439f7ff2d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.079807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.080436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.080716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.080990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.088852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.090599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.099524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 546/1107] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:14.106239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.116727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fda63-aa2b-4d39-83a4-76e503d9d91a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.122953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.123758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.124031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.124340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.135992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.137913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.155576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:37:14.156801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 562/1108] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:14.163187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.172505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd8d4a-e4f7-47b8-8af5-c4aa9f98686a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.178340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.178985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.179261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.179525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.180287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:14.180586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.182328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.193815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 547/1109] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.200105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.211337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b35e2b-3f54-4000-addb-4753a9872798 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.219287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.220178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.220534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.220897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.228184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.230227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.242972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:37:14.244695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 563/1110] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:14.253223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.263400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6196a7-1a70-403b-88b0-215820befde4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.268140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.268822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.269105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.269381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.270186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:14.270494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.272367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed31fb-2f49-4e89-bfc5-62cc87783184 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.285400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 548/1111] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.292653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.303656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fb4b-b799-4265-a7c6-c8e3c367a01c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.309545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.310168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.310459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.310717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.311559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] RBAC: Adding query filter params (role.id=5090dc8665a44bdf813cd724a9428acf, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=2a5832639148459ca8895ae9e26e4b1a) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:14.311870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.313725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3472-081d-444b-bca8-ae165b793964 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.319986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 564/1112] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/role_assignments?user.id=2a5832639148459ca8895ae9e26e4b1a&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5090dc8665a44bdf813cd724a9428acf => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.363660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5d3-b642-4c98-a5d6-d276aeadaee5 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.363852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5d3-b642-4c98-a5d6-d276aeadaee5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.364122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5d3-b642-4c98-a5d6-d276aeadaee5 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.366047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 549/1113] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:14.373563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.373845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.374121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.394189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:14.395768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:14.405442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 565/1114] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:14.430058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd5d3-b642-4c98-a5d6-d276aeadaee5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.444941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd5d3-b642-4c98-a5d6-d276aeadaee5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.450494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.451316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.451618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.451878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.464296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:14.471296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:14.472628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 550/1115] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:14.480031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.489590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48f5a-72df-4b19-b913-79750ed1eec7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.495857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.496703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.497408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.497758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.498618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:14.498925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.500577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.510529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 566/1116] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.517492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.528634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19d7e0-f7d7-4e16-821b-ec6a6f3493b6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.535883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.536960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.537263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.537617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] PATH_INFO: `/v3/users/8737012e7c4f40dfa7ff6e92c31357df` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.539213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] RBAC: Authorizing `identity:get_user(user_id=8737012e7c4f40dfa7ff6e92c31357df)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.541827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.543478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 551/1117] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/users/8737012e7c4f40dfa7ff6e92c31357df => generated 285 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.550327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.560631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874b58-3cf2-466c-b54e-89cac2f4754e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.567306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.567306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.567306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.567306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.568450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.570502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3345f66-2e9e-435c-8236-b55d14252eeb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.572349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 567/1118] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:14 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:14.580327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:14.591468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ab7f-34b5-4e12-a824-3fdd7230866c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:14.596319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:14.597206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:14.597485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:14.597776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be/users/8737012e7c4f40dfa7ff6e92c31357df/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:14.599773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=399b39f4ec5d47f0a014cd8baf0872be, user_id=8737012e7c4f40dfa7ff6e92c31357df, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:14.602454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48d1f-0a8e-41b4-9b70-7da7b07032aa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:14.617449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 552/1119] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:37:14 2021] PUT /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be/users/8737012e7c4f40dfa7ff6e92c31357df/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:37:16.973316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea2b0-71e1-4af0-8e79-29d49000bc8f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:16.974119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea2b0-71e1-4af0-8e79-29d49000bc8f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:16.974119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea2b0-71e1-4af0-8e79-29d49000bc8f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:16.976948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 568/1120] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:16.983174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:16.983591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:16.983681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.011126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:17.012331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:17.074648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 553/1121] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:17.113320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea2b0-71e1-4af0-8e79-29d49000bc8f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.131008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea2b0-71e1-4af0-8e79-29d49000bc8f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.137169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.137952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.138237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.138512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.150973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:17.157753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:17.158905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 569/1122] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:17.169119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.178258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afbbe8-e8ae-46d6-8a79-e3c4ea87206d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.183428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.184085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.184400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.184660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.185431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:17.185738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:17.187345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:17.195578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 554/1123] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:17.203671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.214781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba9420-9c86-4781-8400-8d92de4bcca3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.219735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.220626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.220909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.221182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] PATH_INFO: `/v3/users/8737012e7c4f40dfa7ff6e92c31357df` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.222486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] RBAC: Authorizing `identity:get_user(user_id=8737012e7c4f40dfa7ff6e92c31357df)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:17.224720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:17.226235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 570/1124] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/users/8737012e7c4f40dfa7ff6e92c31357df => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:17.235624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.245696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7654-c834-4a10-9543-764259a07fc2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.251574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.252246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.252523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.252792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.260864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:17.262662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:17.271758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 555/1125] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:37:17.278470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.289332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cc75c-0759-4002-82f3-b12452fcaefd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.295060 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.295929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.296230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.296509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.297809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:17.299810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feace42-a753-4d48-9349-55a347b01f75 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:17.301509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 571/1126] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:17.308518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:17.323003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254de43-b0ca-4dde-82cc-935b7afded1e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:17.331585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:17.332537 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:17.332887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:17.333255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:17.334535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=399b39f4ec5d47f0a014cd8baf0872be, user.id=8737012e7c4f40dfa7ff6e92c31357df) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:17.334938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:17.337786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee02f92-53a6-4c93-8d29-3b807e8976c3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:17.344284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 556/1127] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:17 2021] GET /identity/v3/role_assignments?user.id=8737012e7c4f40dfa7ff6e92c31357df&scope.project.id=399b39f4ec5d47f0a014cd8baf0872be&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:19.709070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5dff-7dcc-4073-848e-93bcde4676c1 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:19.709951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5dff-7dcc-4073-848e-93bcde4676c1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:19.709951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b5dff-7dcc-4073-848e-93bcde4676c1 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:19.712970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 572/1128] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:19.719617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:19.720409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:19.720551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:19.749133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:19.750355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:19.759792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 557/1129] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:19.797734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5dff-7dcc-4073-848e-93bcde4676c1 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:19.812132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b5dff-7dcc-4073-848e-93bcde4676c1 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:19.817265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:19.818052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:19.818329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:19.818595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:19.819947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:19.821587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4032-3fb0-460a-9c62-8d9ccf5d0d4a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:19.823352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 573/1130] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:19.830137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:19.845320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eb097-1bca-4335-abf4-eb43a539f732 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:19.854214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:19.854909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:19.855197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:19.855466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:19.856282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:19.858254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d507c7-13a5-4590-9b00-36ae7bc7a043 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:19.880097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 558/1131] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:37:19 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:22.224618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604670-ea5a-4304-a3ee-ca22ec58c386 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.225483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604670-ea5a-4304-a3ee-ca22ec58c386 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.225483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604670-ea5a-4304-a3ee-ca22ec58c386 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.228483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 574/1132] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:22.238286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.238693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.238907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.265862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:22.267067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:22.276444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 559/1133] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:22.302054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604670-ea5a-4304-a3ee-ca22ec58c386 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:22.318103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604670-ea5a-4304-a3ee-ca22ec58c386 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:22.323768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:22.324668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.324956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.325233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] PATH_INFO: `/v3/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.326934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] RBAC: Authorizing `identity:get_role(role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:22.327968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:37:22.327968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:37:22.327968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:37:22.328889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:22.330208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 575/1134] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:22 2021] GET /identity/v3/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 223 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:22.336273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:22.345895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ac78b-b3d6-4c40-b763-ccfae89be65c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:22.351243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:22.352096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.352409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.352688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] PATH_INFO: `/v3/users/47a2f71d4d384b62968411d2fc5b7852` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.366499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=47a2f71d4d384b62968411d2fc5b7852)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:22.368778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:22.370400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 560/1135] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:22 2021] GET /identity/v3/users/47a2f71d4d384b62968411d2fc5b7852 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:22.377616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:22.394074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c395e-c9e0-4a97-b895-67bef4bc5496 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:22.402291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:22.402919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.403201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.403466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.411995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:22.413800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:22.422866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 576/1136] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:22.429112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:22.439586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801711c2-3a88-4226-9ce6-47c94c2d19a5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:22.444977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:22.445829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.446108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.446382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.447700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:22.449746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003f148-bfe1-4fc8-9c88-8deda1099eca admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:22.451395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 561/1137] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:22 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:22.458298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:22.469210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00616-ec38-41e8-b201-ea8902cf8c55 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:22.474853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:22.475416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:22.475697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:22.475966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:22.476849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=399b39f4ec5d47f0a014cd8baf0872be, user.id=47a2f71d4d384b62968411d2fc5b7852) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:22.477155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:22.478939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b8ae2-b11f-4bf0-a5b1-a84c5add17d5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:22.484757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 577/1138] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:22 2021] GET /identity/v3/role_assignments?user.id=47a2f71d4d384b62968411d2fc5b7852&scope.project.id=399b39f4ec5d47f0a014cd8baf0872be&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:24.830827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ad3a-ec9c-483a-873b-960bfca9733d None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:24.831392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ad3a-ec9c-483a-873b-960bfca9733d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:24.831392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ad3a-ec9c-483a-873b-960bfca9733d None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:24.833241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 562/1139] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:24.839918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:24.840362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:24.840451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:24.860689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:24.861865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:24.871304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 578/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:24.895789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9ad3a-ec9c-483a-873b-960bfca9733d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:24.911303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9ad3a-ec9c-483a-873b-960bfca9733d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:24.918142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:24.918988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:24.919268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:24.919539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] PATH_INFO: `/v3/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:24.921246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] RBAC: Authorizing `identity:get_role(role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:24.922334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:37:24.922334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:37:24.922334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:37:24.923215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:24.924620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 563/1141] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:24 2021] GET /identity/v3/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 223 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:24.933630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:24.942963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197114-3b4a-4232-8951-8ae3357706b4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:24.948885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:24.949779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:24.950063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:24.950336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] PATH_INFO: `/v3/users/47a2f71d4d384b62968411d2fc5b7852` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:24.951700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] RBAC: Authorizing `identity:get_user(user_id=47a2f71d4d384b62968411d2fc5b7852)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:24.953853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:24.955436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 579/1142] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:24 2021] GET /identity/v3/users/47a2f71d4d384b62968411d2fc5b7852 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:24.961597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:24.972401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8b959-5cff-4015-bd3c-88f2c322413d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:24.978381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:24.979191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:24.979470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:24.979738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:24.981123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:24.983136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054e68b-ef94-4b80-8d7f-1d9df3ac2f2d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:24.984782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 564/1143] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:24 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:24.991051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:25.001177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec0f84-13f6-40d5-9ef1-8b77a17e220f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:25.007412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:25.008699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:25.009363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:25.009363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be/users/47a2f71d4d384b62968411d2fc5b7852/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:25.012136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399b39f4ec5d47f0a014cd8baf0872be, user_id=47a2f71d4d384b62968411d2fc5b7852, role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:25.014750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b0c80-b589-47c1-ab37-53ff4569d0d0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:25.031037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 580/1144] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:37:24 2021] PUT /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be/users/47a2f71d4d384b62968411d2fc5b7852/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:37:27.359271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083457c5-8f2b-4215-9a7a-7b5bc3e634d6 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.359884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083457c5-8f2b-4215-9a7a-7b5bc3e634d6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.359884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083457c5-8f2b-4215-9a7a-7b5bc3e634d6 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.361703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 565/1145] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:27.368856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.369355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.369688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.394474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:27.395660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:27.456361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 581/1146] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:27.489985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083457c5-8f2b-4215-9a7a-7b5bc3e634d6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:27.504674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083457c5-8f2b-4215-9a7a-7b5bc3e634d6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:27.510491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:27.511349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.511629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.511906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] PATH_INFO: `/v3/roles/3fd21601bfde4f109fbcc468c81dc59b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.513605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] RBAC: Authorizing `identity:get_role(role_id=3fd21601bfde4f109fbcc468c81dc59b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:27.515269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:27.516626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 566/1147] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:27 2021] GET /identity/v3/roles/3fd21601bfde4f109fbcc468c81dc59b => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:27.523501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:27.538453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afbd83-4718-4c5e-abc5-469e43f417e2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:27.545514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:27.546369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.546649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.546919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] PATH_INFO: `/v3/users/47a2f71d4d384b62968411d2fc5b7852` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.548385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] RBAC: Authorizing `identity:get_user(user_id=47a2f71d4d384b62968411d2fc5b7852)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:27.550544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:27.552123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 582/1148] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:27 2021] GET /identity/v3/users/47a2f71d4d384b62968411d2fc5b7852 => generated 286 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:27.562385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:27.576452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a7ca-1d21-437f-8a35-656dbb7175d7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:27.582522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:27.583160 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.583436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.583702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.596185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:27.597950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:27.609864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 567/1149] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:27 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:27.617121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:27.629011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5438-ed32-4160-8e97-454498a26f1d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:27.635019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:27.635878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.636178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.636474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] PATH_INFO: `/v3/projects/399b39f4ec5d47f0a014cd8baf0872be` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.637899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] RBAC: Authorizing `identity:get_project(project_id=399b39f4ec5d47f0a014cd8baf0872be)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:27.639963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96791a6e-2ada-42e7-8595-6e9ed17d061e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:27.641649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 583/1150] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:27 2021] GET /identity/v3/projects/399b39f4ec5d47f0a014cd8baf0872be => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:27.648007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:27.656830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2b54-6572-47d7-b4c5-cc97c3574a93 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:27.661827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:27.662452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:27.662730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:27.662997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:27.663836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] RBAC: Adding query filter params (role.id=3fd21601bfde4f109fbcc468c81dc59b, scope.project.id=399b39f4ec5d47f0a014cd8baf0872be, user.id=47a2f71d4d384b62968411d2fc5b7852) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:27.664143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:27.666015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8d61-ee2f-4737-891d-028292420e16 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:27.671842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 568/1151] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:27 2021] GET /identity/v3/role_assignments?user.id=47a2f71d4d384b62968411d2fc5b7852&scope.project.id=399b39f4ec5d47f0a014cd8baf0872be&role.id=3fd21601bfde4f109fbcc468c81dc59b => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:30.034934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6288-555e-45f9-8bef-c8e1b9bcf794 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:30.035756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6288-555e-45f9-8bef-c8e1b9bcf794 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:30.035756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6288-555e-45f9-8bef-c8e1b9bcf794 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:30.038730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 584/1152] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:30.044802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:30.045232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:30.045319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:30.064834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:30.066008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:30.074655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 569/1153] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:30.100007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6288-555e-45f9-8bef-c8e1b9bcf794 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:30.120834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6288-555e-45f9-8bef-c8e1b9bcf794 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:30.127042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:30.127908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:30.128180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:30.128499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:30.129913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:30.131603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5faeb-14d2-487c-85ef-1ac5b5361930 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:30.133203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 585/1154] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:30.139444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:30.148349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc703b-a556-45c6-a664-52179f6db00f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:30.154327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:30.154975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:30.155261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:30.155536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:30.156324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:30.158241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2868f-3a7b-4e26-81ac-be664fa92181 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:30.187844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 570/1155] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:37:30 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:32.574099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7984c-cf06-4ac2-9ffd-e1a4b2f5a61e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:32.574792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7984c-cf06-4ac2-9ffd-e1a4b2f5a61e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:32.574906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7984c-cf06-4ac2-9ffd-e1a4b2f5a61e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:32.577003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 586/1156] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:32.584635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:32.585099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:32.585190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:32.610446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:32.611634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:32.669918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 571/1157] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:32.706755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7984c-cf06-4ac2-9ffd-e1a4b2f5a61e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:32.721838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7984c-cf06-4ac2-9ffd-e1a4b2f5a61e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:32.727214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:32.728000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:32.728309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:32.728602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:32.729793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:32.731478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c0963-9d38-4e42-a840-01dc087e869e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:32.733081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 587/1158] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:37:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:32.739595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:32.754889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2749bd4-a5e6-4413-b1d8-f7c0d6cc9d53 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:32.762583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:32.763241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:32.763526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:32.763801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:32.764571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:32.766529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b115-3b93-464a-bc09-660a39d13e33 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:32.788384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 572/1159] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:37:32 2021] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:35.150221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a10d-589e-47c9-81e1-d3fb4ebb7f7a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.150902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a10d-589e-47c9-81e1-d3fb4ebb7f7a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.150902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790a10d-589e-47c9-81e1-d3fb4ebb7f7a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.152594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 588/1160] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:35.159573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.160320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.160513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.187416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:35.188656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:35.198110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 573/1161] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:35.223234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790a10d-589e-47c9-81e1-d3fb4ebb7f7a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.236037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790a10d-589e-47c9-81e1-d3fb4ebb7f7a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.240924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.241725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.242004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.242272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.253655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:35.260441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:35.261580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 589/1162] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:35.268484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.281284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec9c2d-7f26-489c-ac36-7aae44b8d8f2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.287896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.288587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.288879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.289148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.289933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:35.290236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:35.291831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:35.301422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 574/1163] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:35.307541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.317609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37593-83c7-4a92-bb14-846a6fd32321 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.322579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.323411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.323687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.323960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] PATH_INFO: `/v3/users/244f2757b8a549f6a9737c513f64fde6` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.336687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] RBAC: Authorizing `identity:get_user(user_id=244f2757b8a549f6a9737c513f64fde6)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:35.339054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:35.340736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 590/1164] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/users/244f2757b8a549f6a9737c513f64fde6 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:35.347216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.358676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6d9d0-0946-4dbc-8545-dbb853654eb3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.365351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.365983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.366265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.366535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.375515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:35.377313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:35.386376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 575/1165] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:37:35.392271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.403882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755bb28-e8b3-41ad-9e0f-efc515e4d63b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.411905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.413301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.413764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.414215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] PATH_INFO: `/v3/projects/0344858a00fb41e4a6ad5738c96f6a87` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.416120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] RBAC: Authorizing `identity:get_project(project_id=0344858a00fb41e4a6ad5738c96f6a87)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:35.419303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cf398-a07c-4a7f-a1a6-8ccb8407e941 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:35.422012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 591/1166] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/projects/0344858a00fb41e4a6ad5738c96f6a87 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:35.428379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:35.437428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff678-ce54-4908-818a-3322d1f56dab admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:35.442454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:35.443072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:35.443357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:35.443633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:35.444501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=0344858a00fb41e4a6ad5738c96f6a87, user.id=244f2757b8a549f6a9737c513f64fde6) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:35.444808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:35.446650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff52d9f-9268-4a53-8201-813c3322fc64 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:35.452095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 576/1167] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:35 2021] GET /identity/v3/role_assignments?user.id=244f2757b8a549f6a9737c513f64fde6&scope.project.id=0344858a00fb41e4a6ad5738c96f6a87&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:37.800132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefabf1-f9da-4a83-8d4a-c39589c071c3 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:37.800720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefabf1-f9da-4a83-8d4a-c39589c071c3 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:37.800720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefabf1-f9da-4a83-8d4a-c39589c071c3 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:37.803534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 592/1168] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:37.813718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:37.814168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:37.814287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:37.839677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:37.840828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:37.850174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 577/1169] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:37.887565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefabf1-f9da-4a83-8d4a-c39589c071c3 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:37.903225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefabf1-f9da-4a83-8d4a-c39589c071c3 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:37.908871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:37.909670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:37.909952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:37.910232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:37.921610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:37.928590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:37.929635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 593/1170] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:37.936569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:37.946102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb66e-2f2d-42c7-9a8e-379e282293cf None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:37.952241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:37.952909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:37.953185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:37.953455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:37.954209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:37.954508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:37.956132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:37.964818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 578/1171] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:37.971184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:37.983174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da30e2-2455-403b-b904-838e96c2f371 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:37.988862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:37.989725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:37.990006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:37.990279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] PATH_INFO: `/v3/users/244f2757b8a549f6a9737c513f64fde6` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:37.991601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] RBAC: Authorizing `identity:get_user(user_id=244f2757b8a549f6a9737c513f64fde6)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:37.993814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:37.995355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 594/1172] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:37 2021] GET /identity/v3/users/244f2757b8a549f6a9737c513f64fde6 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:38.001826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:38.012734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb8adc-e192-40bd-a0f3-6aa82e71ccae admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:38.018531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:38.019384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:38.019660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:38.019929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] PATH_INFO: `/v3/projects/0344858a00fb41e4a6ad5738c96f6a87` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:38.021279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] RBAC: Authorizing `identity:get_project(project_id=0344858a00fb41e4a6ad5738c96f6a87)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:38.023307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e4325-575c-44cc-b114-40c58ab67d21 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:38.024992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 579/1173] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:38 2021] GET /identity/v3/projects/0344858a00fb41e4a6ad5738c96f6a87 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:38.031167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:38.041386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc838cb5-1bd1-45f5-9ba6-07d5baca0186 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:38.047887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:38.048773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:38.049052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:38.049321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] PATH_INFO: `/v3/projects/0344858a00fb41e4a6ad5738c96f6a87/users/244f2757b8a549f6a9737c513f64fde6/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:38.051723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0344858a00fb41e4a6ad5738c96f6a87, user_id=244f2757b8a549f6a9737c513f64fde6, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:38.054374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6774-5e0c-4a0c-ab7c-06a87bf590d3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:38.072269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 595/1174] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:37:38 2021] PUT /identity/v3/projects/0344858a00fb41e4a6ad5738c96f6a87/users/244f2757b8a549f6a9737c513f64fde6/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:37:40.391130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d08a-3a86-4080-a988-b1cbbeae8af8 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.392028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d08a-3a86-4080-a988-b1cbbeae8af8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.392028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3d08a-3a86-4080-a988-b1cbbeae8af8 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.394889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 580/1175] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:40.401001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.401455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.401548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.421515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:40.422713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:40.480877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 596/1176] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:37:40.506835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3d08a-3a86-4080-a988-b1cbbeae8af8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.527674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3d08a-3a86-4080-a988-b1cbbeae8af8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.533740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.534516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.534799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.535047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.546318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:40.553100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:40.554291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 581/1177] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:40.561531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.570933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e09ed-15dc-471b-b704-e353c2415bb5 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.577165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.577840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.578115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.578381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.579514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:40.580011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:40.582574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:40.593422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 597/1178] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:40.600025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.611136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaf222-8f35-4f33-8148-227711b8e460 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.617141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.618167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.618450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.618729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] PATH_INFO: `/v3/users/244f2757b8a549f6a9737c513f64fde6` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.620099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] RBAC: Authorizing `identity:get_user(user_id=244f2757b8a549f6a9737c513f64fde6)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:40.622566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:40.624185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 582/1179] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/users/244f2757b8a549f6a9737c513f64fde6 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:40.630412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.640512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef5df9-11b5-4359-a7cf-d5ea3c2551a4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.646403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.646986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.647266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.647532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.655903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:40.657646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:40.666798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 598/1180] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:40.673181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.683526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069418-8d4a-4cc4-9618-dd8f4a70c502 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.689431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.690256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.690540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.690813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] PATH_INFO: `/v3/projects/0344858a00fb41e4a6ad5738c96f6a87` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.692139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] RBAC: Authorizing `identity:get_project(project_id=0344858a00fb41e4a6ad5738c96f6a87)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:40.694191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362439b-1546-4f2f-b6ca-9dcea77d352b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:40.695836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 583/1181] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/projects/0344858a00fb41e4a6ad5738c96f6a87 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:40.702344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:40.711159 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277570-ee34-4580-ae6d-82cd30e94c22 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:40.717364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:40.717980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:40.718254 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:40.718519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:40.719365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=0344858a00fb41e4a6ad5738c96f6a87, user.id=244f2757b8a549f6a9737c513f64fde6) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:40.719671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:40.721477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429462a-6a1d-47ee-b094-e4852b139235 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:40.727605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 599/1182] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:40 2021] GET /identity/v3/role_assignments?user.id=244f2757b8a549f6a9737c513f64fde6&scope.project.id=0344858a00fb41e4a6ad5738c96f6a87&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:43.201969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0dc6-a0f7-4e6c-a2be-619604c03444 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:43.202903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0dc6-a0f7-4e6c-a2be-619604c03444 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:43.202903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0dc6-a0f7-4e6c-a2be-619604c03444 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:43.205783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 584/1183] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:43.213270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:43.214580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:43.214968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:43.238890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:43.240084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:43.249950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 600/1184] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:43.274029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0dc6-a0f7-4e6c-a2be-619604c03444 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:43.288456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0dc6-a0f7-4e6c-a2be-619604c03444 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:43.294714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:43.295374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:43.295650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:43.295922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:43.304384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:43.306375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:43.315522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 585/1185] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:43.322114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:43.331726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfa7bc-96ca-4c27-8476-9a8924ec7366 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:43.337026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:43.337851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:43.338129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:43.338401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:43.346142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:43.347958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:43.362701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-c47b9f38-f2cd-41c3-af6e-931fdb0e96bd admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 25 04:37:43.363847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 601/1186] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:37:43 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:43.371641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:43.386584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c8e-ea7c-48d5-bf86-bd68f1a89de2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:43.395263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:43.396349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:43.396819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:43.397270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:43.398457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:43.398969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:43.400829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f26fa-2359-4757-bb83-f869e96cd377 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:43.408480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 586/1187] 10.222.0.36 () {56 vars in 1136 bytes} [Thu Nov 25 04:37:43 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:45.699442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f63e-065e-4661-ab22-81eb127ae21e None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:45.700295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f63e-065e-4661-ab22-81eb127ae21e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:45.700295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f63e-065e-4661-ab22-81eb127ae21e None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:45.703176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 602/1188] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:45.712998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc30da-a89e-4ec0-af31-70d41abb5100 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:45.713454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc30da-a89e-4ec0-af31-70d41abb5100 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:45.713546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc30da-a89e-4ec0-af31-70d41abb5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:45.734081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f5dc30da-a89e-4ec0-af31-70d41abb5100 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:45.735274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f5dc30da-a89e-4ec0-af31-70d41abb5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:45.745191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 587/1189] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:45.770233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f63e-065e-4661-ab22-81eb127ae21e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:45.785465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f63e-065e-4661-ab22-81eb127ae21e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:45.791356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:45.792015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:45.792334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:45.792609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:45.793374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:45.794399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:37:45.794399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:37:45.794399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:37:45.795284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386884a-0e82-4dc3-9380-6f48836eff0f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:45.812915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 603/1190] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Nov 25 04:37:45 2021] POST /identity/v3/domains => generated 267 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:48.199159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7d41-466b-45cd-af84-cfcfcc7b62b9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:48.200019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7d41-466b-45cd-af84-cfcfcc7b62b9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:48.200019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7d41-466b-45cd-af84-cfcfcc7b62b9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:48.202957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 588/1191] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:48.209079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:48.209518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:48.209610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:48.228138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:48.229969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:48.293972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 604/1192] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:48.319311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a7d41-466b-45cd-af84-cfcfcc7b62b9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:48.334853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a7d41-466b-45cd-af84-cfcfcc7b62b9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:48.340646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:48.341492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:48.341772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:48.342042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] PATH_INFO: `/v3/domains/03e2cf20d32440f48178d154c39527ec` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:48.353465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=03e2cf20d32440f48178d154c39527ec)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:48.355384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b27c-351d-4403-a0e6-db0cc36bd1f8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:48.357009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 589/1193] 10.222.0.36 () {56 vars in 1204 bytes} [Thu Nov 25 04:37:48 2021] GET /identity/v3/domains/03e2cf20d32440f48178d154c39527ec => generated 267 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:48.366484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:48.381538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999dd81-22ba-4ee3-8f34-9789ef3804f0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:48.388028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:48.388705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:48.388982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:48.389248 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:48.389981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:48.391848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229332b2-93f7-4c8e-8424-dd37e6188fe9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:48.422097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 605/1194] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:37:48 2021] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:50.750445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555fed-b705-48e0-ba66-c9537d66829f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:50.751017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555fed-b705-48e0-ba66-c9537d66829f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:50.751017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555fed-b705-48e0-ba66-c9537d66829f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:50.752789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 590/1195] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:50.758776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:50.759195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:50.759285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:50.778626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:50.779775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:50.837411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 606/1196] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:50.863068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555fed-b705-48e0-ba66-c9537d66829f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:50.878643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555fed-b705-48e0-ba66-c9537d66829f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:50.883418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:50.884296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:50.884574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:50.884847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] PATH_INFO: `/v3/domains/03e2cf20d32440f48178d154c39527ec` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:50.886189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=03e2cf20d32440f48178d154c39527ec)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:50.888132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7029e-d920-4c4f-9848-a61ab01ef2f4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:50.889738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 591/1197] 10.222.0.36 () {56 vars in 1204 bytes} [Thu Nov 25 04:37:50 2021] GET /identity/v3/domains/03e2cf20d32440f48178d154c39527ec => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:50.896120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:50.905875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4766498-3c7d-419b-9044-2aebff937114 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:50.910521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:50.911183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:50.911465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:50.911739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:50.912541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:50.914549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919ac4-6cf6-44b4-a01f-5ea9d00e5a9c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:50.938002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 607/1198] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:37:50 2021] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:37:53.313644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6d89-adc2-4348-8066-be582236b762 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.314530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6d89-adc2-4348-8066-be582236b762 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.314530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db6d89-adc2-4348-8066-be582236b762 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.317687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 592/1199] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:53.324094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.324553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.324654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.343751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:53.344984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:53.353225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 608/1200] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:53.378436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6d89-adc2-4348-8066-be582236b762 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.393488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db6d89-adc2-4348-8066-be582236b762 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.399061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.399933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.400245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.400525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.412399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:53.419267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:53.420451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 593/1201] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:53.426880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.435988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896324d8-a91f-4d56-ab63-afc2e89a0faf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.441567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.442216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.442499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.442774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.443551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:53.443857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:53.445476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:53.453901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 609/1202] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:37:53.459997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.471173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba105d-1efc-4316-9b33-3c6a248d7167 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.477164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.478014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.478297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.478587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] PATH_INFO: `/v3/users/eb2afecef49a4f71ad97ca8694255849` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.494633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] RBAC: Authorizing `identity:get_user(user_id=eb2afecef49a4f71ad97ca8694255849)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:53.497184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:53.498788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 594/1203] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/users/eb2afecef49a4f71ad97ca8694255849 => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:53.505350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.516080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf8e3-3b63-4618-8786-e129c1c5f564 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.521733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.522361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.522645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.522918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.531214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:53.532997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:53.541915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 610/1204] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:37:53.548284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.559713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3635b-d82f-4c8a-84b7-8de8dfce579b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.566306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.567078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.567357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.567625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] PATH_INFO: `/v3/projects/6923b0868937439da67fd11f09de16f7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.569011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] RBAC: Authorizing `identity:get_project(project_id=6923b0868937439da67fd11f09de16f7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:53.571154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7753053-c221-4d91-bac4-e75a594df00c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:53.572874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 595/1205] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/projects/6923b0868937439da67fd11f09de16f7 => generated 361 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:53.579643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:53.589302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23c72-b321-4fe5-88d1-a298e487ef56 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:53.595144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:53.595791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:53.596071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:53.596389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:53.597230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=6923b0868937439da67fd11f09de16f7, user.id=eb2afecef49a4f71ad97ca8694255849) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:53.597545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:53.599348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de475119-0333-4cb4-8a3b-9cb541619512 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:53.604824 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 611/1206] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:53 2021] GET /identity/v3/role_assignments?user.id=eb2afecef49a4f71ad97ca8694255849&scope.project.id=6923b0868937439da67fd11f09de16f7&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:55.919118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd02a6-2d83-4f45-af3d-7f08d022c4fc None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:55.919646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd02a6-2d83-4f45-af3d-7f08d022c4fc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:55.919646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd02a6-2d83-4f45-af3d-7f08d022c4fc None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:55.921410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 596/1207] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:55.928493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:55.929192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:55.929348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:55.954709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:55.955929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:55.965146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 612/1208] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:55.989176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd02a6-2d83-4f45-af3d-7f08d022c4fc None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:56.004791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd02a6-2d83-4f45-af3d-7f08d022c4fc None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:56.011472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:56.012681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:56.013057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:56.013540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:56.027266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:56.034184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:56.035296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 597/1209] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:56.043016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:56.058293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35ece1-2818-4862-b742-593c2f84ab0a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:56.067531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:56.068562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:56.068927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:56.069290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:56.070478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:56.071417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:56.073100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:56.082799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 613/1210] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:56.089373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:56.099984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff962c-13dc-4274-840a-22562b0cf645 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:56.105400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:56.106265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:56.106531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:56.106804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] PATH_INFO: `/v3/users/eb2afecef49a4f71ad97ca8694255849` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:56.107992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] RBAC: Authorizing `identity:get_user(user_id=eb2afecef49a4f71ad97ca8694255849)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:56.110106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:56.112246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 598/1211] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:56 2021] GET /identity/v3/users/eb2afecef49a4f71ad97ca8694255849 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:56.118481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:56.129244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22ec1-3bf8-4937-a603-233f9882dc39 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:56.134617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:56.135494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:56.137518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:56.137518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] PATH_INFO: `/v3/projects/6923b0868937439da67fd11f09de16f7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:56.137518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] RBAC: Authorizing `identity:get_project(project_id=6923b0868937439da67fd11f09de16f7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:56.139353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36be8-3374-4b4e-a71f-5fdd843e2173 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:56.141380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 614/1212] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:56 2021] GET /identity/v3/projects/6923b0868937439da67fd11f09de16f7 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:56.147613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:56.157692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60727-258f-49a8-b570-afc4f521d53e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:56.162676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:56.163574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:56.163860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:56.164141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] PATH_INFO: `/v3/projects/6923b0868937439da67fd11f09de16f7/users/eb2afecef49a4f71ad97ca8694255849/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:56.166158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6923b0868937439da67fd11f09de16f7, user_id=eb2afecef49a4f71ad97ca8694255849, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:56.168842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636c336-22ab-4548-b31c-26749d46f51b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:56.184816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 599/1213] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:37:56 2021] PUT /identity/v3/projects/6923b0868937439da67fd11f09de16f7/users/eb2afecef49a4f71ad97ca8694255849/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:37:58.510230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bec12-4a58-4487-9ec9-a42296c9b2b1 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.511084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bec12-4a58-4487-9ec9-a42296c9b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.511084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bec12-4a58-4487-9ec9-a42296c9b2b1 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.514053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 615/1214] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:37:58 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:37:58.520947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.521398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.521516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.541429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:37:58.542645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:37:58.605376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 600/1215] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:37:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:37:58.631157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bec12-4a58-4487-9ec9-a42296c9b2b1 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.645478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bec12-4a58-4487-9ec9-a42296c9b2b1 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.650752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.651536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.651822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.652101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.662523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:37:58.669295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:37:58.670449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 616/1216] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:37:58.677429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.691931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5976d5-779f-4112-bfc2-6bfa1158dba5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.701507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.702643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.703093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.703518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.704786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:58.705176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:58.707755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:58.719191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 601/1217] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:58.729963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.746266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201eda9-99f3-4e9f-9280-18df3a856c38 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.752032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.752910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.753187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.753455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] PATH_INFO: `/v3/users/eb2afecef49a4f71ad97ca8694255849` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.754778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] RBAC: Authorizing `identity:get_user(user_id=eb2afecef49a4f71ad97ca8694255849)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:58.756900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:58.758713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 617/1218] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/users/eb2afecef49a4f71ad97ca8694255849 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:58.765044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.775426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce679f4-1e26-4589-9126-b8f4a921b365 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.781731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.782378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.782665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.782938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.791744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:58.793514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:58.802707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 602/1219] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:37:58.810025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.823973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f8b55-e9f6-4945-b690-c81a2bd52adf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.829932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.830778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.831059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.831332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] PATH_INFO: `/v3/projects/6923b0868937439da67fd11f09de16f7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.832820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] RBAC: Authorizing `identity:get_project(project_id=6923b0868937439da67fd11f09de16f7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:58.834877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851301-4c61-41c4-bd33-7f99dbc0ccbc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:58.836713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 618/1220] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/projects/6923b0868937439da67fd11f09de16f7 => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:37:58.843163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:37:58.853096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd3a8-a3eb-4b9e-81eb-8c2e560b2e25 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:37:58.859576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:37:58.860248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:37:58.860526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:37:58.860796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:37:58.861652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=6923b0868937439da67fd11f09de16f7, user.id=eb2afecef49a4f71ad97ca8694255849) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:37:58.861958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:37:58.863799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b596d-f367-49c6-80e2-e3435302eca2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:37:58.870982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 603/1221] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:37:58 2021] GET /identity/v3/role_assignments?user.id=eb2afecef49a4f71ad97ca8694255849&scope.project.id=6923b0868937439da67fd11f09de16f7&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:38:57.404191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114b85-72f7-4ea3-887b-b1a6196b9975 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:38:57.407439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114b85-72f7-4ea3-887b-b1a6196b9975 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:38:57.407439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c114b85-72f7-4ea3-887b-b1a6196b9975 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:38:57.407439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 619/1222] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:38:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:38:57.413639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:38:57.414103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:38:57.414206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:38:57.432983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:38:57.434185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:38:57.442865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 604/1223] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:38:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:38:57.478943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114b85-72f7-4ea3-887b-b1a6196b9975 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:38:57.494655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c114b85-72f7-4ea3-887b-b1a6196b9975 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:38:57.499495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:38:57.500329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:38:57.500610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:38:57.500880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:38:57.512697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:38:57.514605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:38:57.533087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:38:57.534918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 620/1224] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:38:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:38:57.542629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:38:57.551848 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f337f9-2af9-43c3-b25d-f2b96f701f41 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:38:57.556869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:38:57.557523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:38:57.557801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:38:57.558073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:38:57.558850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:38:57.559133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:38:57.560790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea42fb-2d3d-465e-9abc-2f74354b76ba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:38:57.576207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 605/1225] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:38:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:38:57.585561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:38:57.597976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949035fe-f6f8-4399-ba01-6bc60233d84c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:38:57.603141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:38:57.603863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:38:57.604404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:38:57.604524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:38:57.605230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:38:57.607186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381d58-a092-4422-869a-e70f9e15300d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:38:57.633271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 621/1226] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Nov 25 04:38:57 2021] POST /identity/v3/users => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:39:00.278373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b819a5-8fcb-48c5-b46f-3d163fbad28e None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.278912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b819a5-8fcb-48c5-b46f-3d163fbad28e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.278912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b819a5-8fcb-48c5-b46f-3d163fbad28e None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.281022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 606/1227] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:00.288263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.289133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.289133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.309592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:00.310811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:00.319774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 622/1228] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:00.346041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b819a5-8fcb-48c5-b46f-3d163fbad28e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.362549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b819a5-8fcb-48c5-b46f-3d163fbad28e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.368248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.369441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.369739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.370057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.382513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:00.390147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:39:00.391396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 607/1229] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:00.398290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.408586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdcbd-432a-4e35-8df6-c0df99994a3c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.413193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.414097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.414515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.414821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.415696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.416064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.417773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.426241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 623/1230] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:00.433083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.443528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8158e7-d2cc-45f9-9558-967ce9785a83 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.449308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.450115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.450398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.450676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.462314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.464316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.485627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:00.492570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 608/1231] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:00.494447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.505948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2631bb-7425-48f2-8cfa-3c751c038e3e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.512062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.513071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.513379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.513709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.514469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.514776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.516457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.534656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 624/1232] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:00.535964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.547279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171dfe-5c19-4571-bd16-6f6b2a706df2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.553725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.554553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.554831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.555131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.563545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.565713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.581237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:00.587968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 609/1233] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:00.589375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.599945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc6b57-40d9-4f19-9b91-8a7f62150d50 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.605446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.606222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.606573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.606917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.607850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.608193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.610058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.629797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 625/1234] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:00.636498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.647156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effa489-8cbd-4dde-968f-25b31ff292bd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.652568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.653325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.653649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.653921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.662941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.665373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.674884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 610/1235] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:39:00.681563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.693103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501574-b98d-443c-830b-fce9d9ed0543 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.698291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.699283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.699626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.699889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.710403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.712498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.730668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:00.731904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 626/1236] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:00.739270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.749772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f8f09-ed53-450e-ae4d-bc8ae932eb2e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.755049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.755750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.756084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.756392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.757163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.757520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.759296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.772009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 611/1237] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:00.778362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.789028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f0eb8-cdcf-4d14-9bde-b0133857a579 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.794417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.795200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.795482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.795752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.803229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.805304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.823378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:00.824901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 627/1238] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:00.831729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.842547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540946b-07fb-4b52-aa7e-5e3d80ea92f8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.849413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.850083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.850387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.850652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.851552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.851828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.853855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4510b-4339-4844-8c1d-c926ad3bd779 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.869040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 612/1239] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:00.876594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:00.887821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91804b-3e58-4ed9-b894-1d15539b1547 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:00.896418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:00.897118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:00.897409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:00.897662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:00.898544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=755f10706c5f44a79cc402f6accd1edd) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:00.898864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:00.900998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6153a15-b5dc-4d76-b0cb-cf5dfc09413b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:00.908210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 628/1240] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:39:00 2021] GET /identity/v3/role_assignments?user.id=755f10706c5f44a79cc402f6accd1edd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:03.336357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547ac82-5b6a-4ecd-9fc0-57b5b57788b8 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.336940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547ac82-5b6a-4ecd-9fc0-57b5b57788b8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.336940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547ac82-5b6a-4ecd-9fc0-57b5b57788b8 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.338846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 613/1241] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:03.349196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.349685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.349778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.370797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:03.372173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:03.381023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 629/1242] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:03.406607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547ac82-5b6a-4ecd-9fc0-57b5b57788b8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.420607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547ac82-5b6a-4ecd-9fc0-57b5b57788b8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.426045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.426906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.427182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.427451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.438330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:03.445133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:39:03.446907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 614/1243] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:03.454324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.463835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484062c-5b2f-4877-ad4a-051cbc03cc7c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.468725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.469423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.469759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.470033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.470845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:03.471154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.472779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.484215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 630/1244] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:03.488594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.499144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852adc0-7d06-435e-a231-bc5316fe669f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.505012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.505807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.506091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.506364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.519968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.522013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.539439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:03.541302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 615/1245] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:03.547976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.559125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a563ff-be65-4adc-9a0d-02cb16b73310 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.564565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.565444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.565722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.565991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.566744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:03.567079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.569236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.585818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 631/1246] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:03.592882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.605092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7af9f-9ff3-4948-86ac-faf4575c55c7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.610782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.611601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.611883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.612282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.622725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.625071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.641140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:03.642365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 616/1247] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:03.649424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.660783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f028f-d25c-44f1-9c8d-d6177829f42a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.665857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.666575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.666903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.667317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.668116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:03.668453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.670332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.690468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 632/1248] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:03.697336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.708242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3136d-e9c4-4612-bbfd-90d9b97fefb9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.713316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.714135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.714445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.714733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.727157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.729256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.747384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:03.748669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 617/1249] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:03.755385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.766419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c92cc1-e579-435e-a24b-7e8680825d96 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.772408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.773186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.773499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.773841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.774696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:03.775014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.776698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.792888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 633/1250] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:03.799233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.809005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954b21-b5c7-431b-9778-2838acc03e61 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.813339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.814138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.814543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.814710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.822847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.825031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.839820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:03.841189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 618/1251] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:03.848514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.859244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77554a60-44bc-4a5f-a528-dd15866b7c9a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.864188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.864915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.865233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.865545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.866435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:03.866825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.869362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309e1b5-82af-4834-8ef8-8d9f1baabe66 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.881894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 634/1252] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:03.888511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:03.898289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63c379-a255-4e62-814a-0e56bd3b8354 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:03.903593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:03.904733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:03.905041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:03.905315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/755f10706c5f44a79cc402f6accd1edd/roles/0624e344d8de496f87f86a6516ae0732` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:03.922644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=755f10706c5f44a79cc402f6accd1edd, role_id=0624e344d8de496f87f86a6516ae0732)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:03.925431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264c1af-9837-435f-a73d-0b3a1f973a0c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:03.941034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 619/1253] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:39:03 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/755f10706c5f44a79cc402f6accd1edd/roles/0624e344d8de496f87f86a6516ae0732 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:39:06.592845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c512f8-6c13-427e-b75a-52aadc97181d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.593386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c512f8-6c13-427e-b75a-52aadc97181d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.593386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c512f8-6c13-427e-b75a-52aadc97181d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.595207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 635/1254] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:06.603000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.603472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.603827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.624972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:06.626189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:06.689821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 620/1255] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:06.716811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c512f8-6c13-427e-b75a-52aadc97181d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.731186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c512f8-6c13-427e-b75a-52aadc97181d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.735553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.736416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.736700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.736976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.748368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:06.755209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 25 04:39:06.757580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 636/1256] 10.222.0.36 () {56 vars in 1123 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:06.764396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.774202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2682962-df58-4cd4-97b3-9e17ce846050 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.779674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722407d-3829-4374-a297-557dde295824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.780401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722407d-3829-4374-a297-557dde295824 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.780695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722407d-3829-4374-a297-557dde295824 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.780981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722407d-3829-4374-a297-557dde295824 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.781709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722407d-3829-4374-a297-557dde295824 admin admin] RBAC: Adding query filter params (name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:06.782013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722407d-3829-4374-a297-557dde295824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:06.783643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722407d-3829-4374-a297-557dde295824 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:06.792872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 621/1257] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:06.799584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.810194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afaa077-5bda-46a0-b933-98249a60264d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.814909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.815698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.815980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.816290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.827092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:06.829095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:06.850701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:06.851923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 637/1258] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:06.860182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722407d-3829-4374-a297-557dde295824 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.871745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722407d-3829-4374-a297-557dde295824 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.877118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.877776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.878068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.878375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.879314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:06.879621 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:06.881333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:06.895535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 622/1259] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:06.902817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.918073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd7cc6-7229-46db-aadd-b49884483cf9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.922996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.923849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.924137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.924444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.932559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:06.934565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:06.949688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:06.951000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 638/1260] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:06.957781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:06.968678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68bb5-afc4-4162-8e6d-982b22083f44 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:06.973835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:06.974502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:06.974822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:06.975138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:06.976033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:06.976366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:06.978315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:06.996616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 623/1261] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:07.004850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.016276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f770f-45ac-4589-9d92-a1fa01470e6b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.022050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.022845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.023286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.023747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.034817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.036958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.047622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 639/1262] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:39:07.054592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.064665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdfa71-2a43-4412-be98-801bf08d22cb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.070112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.071070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.071354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.071783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.082402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.084184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.102902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:07.104265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 624/1263] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:07.111440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.123614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1232-4b2c-4efe-adf2-a47f4cd90250 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.132242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.133013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.133429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.133841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.134827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:07.135133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.136782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.150990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 640/1264] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:07.157841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.168435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062cc8-13cc-4471-92a1-1ac3793fcb9a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.173207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.174101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.174430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.174716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.183245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.185295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.199922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:07.201206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 625/1265] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:07.211455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.223164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8652cc-7948-4448-9893-07db0b84b4b2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.231610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.232497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.232959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.233190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.234142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:07.234504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.236777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab69887-a8a4-48f2-81d3-43fb20f35acc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.254424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 641/1266] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:07.263059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:07.277874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddc3e8-5f5f-4d15-8305-1004c68001fd admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:07.283020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:07.283688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:07.283979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:07.284396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:07.285290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] RBAC: Adding query filter params (role.id=0624e344d8de496f87f86a6516ae0732, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=755f10706c5f44a79cc402f6accd1edd) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:07.285595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:07.287461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b024e-09e0-40a5-87b1-8d470f5bed90 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:07.293840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 626/1267] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:39:07 2021] GET /identity/v3/role_assignments?user.id=755f10706c5f44a79cc402f6accd1edd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=0624e344d8de496f87f86a6516ae0732 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:09.797730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac183f-944d-49b6-bd6c-fd2f70ed2bb7 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:09.798347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac183f-944d-49b6-bd6c-fd2f70ed2bb7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:09.798347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac183f-944d-49b6-bd6c-fd2f70ed2bb7 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:09.800050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 642/1268] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:09.806281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:09.806740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:09.806839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:09.826575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:09.827718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:09.837076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 627/1269] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:09.862465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac183f-944d-49b6-bd6c-fd2f70ed2bb7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:09.876513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac183f-944d-49b6-bd6c-fd2f70ed2bb7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:09.881431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:09.882413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:09.882770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:09.883129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:09.893817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:09.901045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:39:09.902422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 643/1270] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:39:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:09.909257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:09.918675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb2949-19f3-4394-9e76-1f25daf9f571 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:09.923993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:09.924767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:09.925053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:09.925332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:09.926171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:09.926456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:09.928132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:09.936824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 628/1271] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:39:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:09.943514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:09.956530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fb49b-dfdf-4f1c-bd25-bc9563e202f4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:09.961686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:09.962668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:09.962949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:09.963220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:09.975567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:09.978055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:09.996515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:09.998069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 644/1272] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:10.004521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.015104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800156f-c24b-466f-b084-13fc1c955023 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.020115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.020805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.021087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.021360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.022109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:10.022412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.024060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.037839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 629/1273] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:10.045348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.057669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a4615-2a24-40c4-876b-3fe34722e3fa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.062889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.063681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.063965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.064269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.074150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.076198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.090437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:10.091557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 645/1274] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:10.098424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.108440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe1e6-bcda-4329-a02d-83a2ebbe8f85 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.113232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.113964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.114241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.114514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.115440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:10.115747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.117721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.137672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 630/1275] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:10.144625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.154938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11507efb-0440-46c5-a2c6-5eb8ba591191 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.159736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.160415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.160695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.160964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.169930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.171730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.180940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 646/1276] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:39:10.187813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.197742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1abe-92e4-455a-b319-65b160bd9c03 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.202591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.203444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.203695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.203998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.215176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.217092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.234702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:10.235963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 631/1277] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:10.242914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.255403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51aeae-9cb6-4b13-9350-c812a2ff046c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.262018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.263096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.263406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.263709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.264717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:10.265045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.266986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.280780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 647/1278] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:10.287385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.297810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562a67-60ff-4d8a-89de-8419cef7ac6a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.302492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.303331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.303612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.303885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.311283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.313274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.326252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:10.327462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 632/1279] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:10.334015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.350895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971bb74-5a53-4ddd-afed-1a0ba670d25a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.357073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.357811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.358092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.358405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.359282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:10.359632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.361521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c78c4d-e7e0-43c4-b3c4-f2d42af6ff6d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.376785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 648/1280] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:10.383534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:10.394502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c7171-9980-41a4-aed2-60b8dea9155c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:10.399896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:10.400655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:10.400936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:10.401212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:10.402190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=755f10706c5f44a79cc402f6accd1edd) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:10.402501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:10.404494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c01326-00f2-4d5f-bbbd-96073afd8f92 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:10.410654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 633/1281] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:39:10 2021] GET /identity/v3/role_assignments?user.id=755f10706c5f44a79cc402f6accd1edd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:12.931359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7960-d3ff-4879-b6d7-1eb9792514a1 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:12.931870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7960-d3ff-4879-b6d7-1eb9792514a1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:12.931870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7960-d3ff-4879-b6d7-1eb9792514a1 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:12.933646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 649/1282] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:12.940232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:12.940661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:12.940863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:12.963282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:12.964691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:12.974252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 634/1283] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:13.001038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7960-d3ff-4879-b6d7-1eb9792514a1 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.014107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7960-d3ff-4879-b6d7-1eb9792514a1 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.019152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.019975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.020297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.020574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.032651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:13.040723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:39:13.042022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 650/1284] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:39:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:13.049010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.058669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2978df3-5c1c-4aa0-b9a9-48798c2e34e7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.063822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.064568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.064819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.065088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.065849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:13.066148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.067724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.077779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 635/1285] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:13.084410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.096245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab49e-017b-4589-88d1-bf7fb7273998 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.100898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.101695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.102039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.102330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.112776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.114642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.131820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:13.133096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 651/1286] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:13.139958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.150028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0f970-1d04-4d57-90c2-f712fd10b10a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.154903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.155572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.155854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.156171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.156986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:13.157280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.158986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.172717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 636/1287] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:13.180374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.192534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fedbde-f2e4-44e5-bd50-97d0aa2f34ba admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.198306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.199157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.199441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.199727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.207543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.209566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.224871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:13.226330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 652/1288] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:13.233369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.246876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e327da-0b55-429d-954e-381d1b745e1e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.253230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.253904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.254183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.254460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.255310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:13.255611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.257524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.281595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 637/1289] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:13.288900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.299529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becd-84d8-41be-a9ff-4e38cbd2b414 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.304654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.305564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.305945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.306223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.317312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.319292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.339087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:13.340656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 653/1290] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:13.347071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.358069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622a54c-5609-4c54-94f8-ab4ad9f15414 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.363005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.363667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.363951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.364285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.365039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:13.365339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.366947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.379515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 638/1291] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:13.386452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.397938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bedd92-c011-43a4-9adf-68975f6319ce admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.405756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.406562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.406841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.407116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.414899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.416900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.430363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:13.431999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 654/1292] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:13.438729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.450647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1566-0b30-422b-9a8b-c6246a2ef642 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.456235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.456922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.457214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.457541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.458473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:13.458880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.461031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f26b-8603-4cfc-a611-ad6fd5a2bbc7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.475869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 639/1293] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:13.483132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:13.494552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2faa5-8d35-4c31-bc30-8c727971da65 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:13.499578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:13.500537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:13.500817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:13.502310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] PATH_INFO: `/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/755f10706c5f44a79cc402f6accd1edd/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:13.503225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdbf5d9919b49808ec8578b9e5f2956, user_id=755f10706c5f44a79cc402f6accd1edd, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:13.506304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1cc2-2cac-4708-9297-e23e28d24df2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:13.522149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 655/1294] 10.222.0.36 () {58 vars in 1460 bytes} [Thu Nov 25 04:39:13 2021] PUT /identity/v3/projects/7fdbf5d9919b49808ec8578b9e5f2956/users/755f10706c5f44a79cc402f6accd1edd/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:39:16.000691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4d65-29de-402f-9420-821c8ff8eaad None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.001234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4d65-29de-402f-9420-821c8ff8eaad None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.001234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d4d65-29de-402f-9420-821c8ff8eaad None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.002931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 640/1295] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:16.009992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.010672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.010852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.040452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:16.041671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:16.103502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 656/1296] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:16.140774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d4d65-29de-402f-9420-821c8ff8eaad None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.156784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d4d65-29de-402f-9420-821c8ff8eaad None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.163264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.164048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.164403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.164659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.175710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 25 04:39:16.182649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 25 04:39:16.183820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 641/1297] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:16.190884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.202231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d00b8-2661-4c21-8250-9c1f096518e4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.207778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.208445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.208724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.208995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.209748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.210049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.211625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.220326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 657/1298] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:16.226844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.238736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826ab6e-aa0b-491c-8e4f-b4bad3d6d058 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.244813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.245605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.245888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.246161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.257481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.259865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.279572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:16.280922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 642/1299] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:16.287431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.297693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f59012-d9e9-41db-922c-56f343aad3d0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.303512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.304209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.304473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.304741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.305662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.305973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.307576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.320441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 658/1300] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:16.327179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.343971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e27ce-788e-476d-88ce-deab48ebe8dc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.354103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.355261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.355617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.355998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] PATH_INFO: `/v3/users/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.368840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.371193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.391806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 25 04:39:16.393001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 643/1301] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:16.399790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.410276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4278-fd0f-4463-b635-a49ec19e9976 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.416918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.417580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.417862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.418133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.419000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.419308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.421219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.443207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 659/1302] 10.222.0.36 () {56 vars in 1164 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:16.450464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.464683 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731cbbb-ff54-443a-acb2-384e2638f3db admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.471006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.471640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.471916 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.472198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.480752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.482527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.491254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 644/1303] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:39:16.497986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.508752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6832-a135-445a-9075-de5e9110cb2e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.514970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.515806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.516090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.516392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.527968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.529879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.547497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 25 04:39:16.548694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 660/1304] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:16.555190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.564599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abd59-f47a-4f06-a41a-0d8d70d15c12 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.570642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.571756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.572037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.572332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.573163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.573454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.575044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.587155 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 645/1305] 10.222.0.36 () {56 vars in 1130 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:16.596437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.606687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e099-f1fa-4d10-899d-db3154139fb0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.612398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.613190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.613474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.613747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.621392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.623388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.636401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING keystone.server.flask.application [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 25 04:39:16.637512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 661/1306] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 25 04:39:16.643722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.653936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5e8a0-c0f6-46ed-8893-b7ab792757f8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.660186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.660844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.661123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.661387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.662179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.662478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.664335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62092d-ae00-4018-b7a1-3751605c78a3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.677749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 646/1307] 10.222.0.36 () {56 vars in 1169 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:16.687578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:16.702004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de061-664c-4dc9-9a4a-64b22cbb015c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:16.707636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:16.708325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:16.708612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:16.708885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:16.709756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] RBAC: Adding query filter params (role.id=5a566cc358594cd0bc74d7f1067c85bc, scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956, user.id=755f10706c5f44a79cc402f6accd1edd) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:16.710072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:16.711985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7e065-5cef-44a3-94c5-3a70e234cc9a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:16.718432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 662/1308] 10.222.0.36 () {56 vars in 1395 bytes} [Thu Nov 25 04:39:16 2021] GET /identity/v3/role_assignments?user.id=755f10706c5f44a79cc402f6accd1edd&scope.project.id=7fdbf5d9919b49808ec8578b9e5f2956&role.id=5a566cc358594cd0bc74d7f1067c85bc => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:19.053162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394649ac-3310-4586-9d31-64db8629f5f9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:19.054028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394649ac-3310-4586-9d31-64db8629f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:19.054028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394649ac-3310-4586-9d31-64db8629f5f9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:19.057316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 647/1309] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:19.064208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:19.064995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:19.065147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:19.086496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:19.087677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:19.096332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 663/1310] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:19.128955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394649ac-3310-4586-9d31-64db8629f5f9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:19.145522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394649ac-3310-4586-9d31-64db8629f5f9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:19.151287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:19.152080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:19.152402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:19.152676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:19.153347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:19.154965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:19.166897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 25 04:39:19.168029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 648/1311] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:39:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:19.174751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:19.184958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa379b-71f3-4838-90a2-d21a6bc7c87b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:19.191519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:19.192184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:19.192490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:19.192762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:19.193494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:19.193826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:19.195530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cf455-d77e-4380-bfff-2ac89c718113 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:19.201604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 664/1312] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Nov 25 04:39:19 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:19.208264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:19.225289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966b3c-3bab-49d5-ade3-35be532d8e11 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:19.233991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:19.235078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:19.235556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:19.235941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] PATH_INFO: `/v3/services` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:19.237184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:19.237667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:19.239312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc4043-f137-40d3-9320-f81440fbaf10 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:19.245322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 649/1313] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Nov 25 04:39:19 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:21.606533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01a2e-da4e-40fa-8235-b8c5095a394a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:21.607202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01a2e-da4e-40fa-8235-b8c5095a394a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:21.607202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d01a2e-da4e-40fa-8235-b8c5095a394a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:21.609059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 665/1314] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:21.618968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90074e7-a572-4b56-a12a-19b82323fa81 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:21.619457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90074e7-a572-4b56-a12a-19b82323fa81 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:21.619457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90074e7-a572-4b56-a12a-19b82323fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:21.637746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b90074e7-a572-4b56-a12a-19b82323fa81 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:21.638929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b90074e7-a572-4b56-a12a-19b82323fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:21.647614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 650/1315] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:21.684141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01a2e-da4e-40fa-8235-b8c5095a394a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:21.705227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d01a2e-da4e-40fa-8235-b8c5095a394a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:21.713412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:21.714078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:21.714351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:21.714616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:21.715354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:21.716987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035e57a-81c0-4bb4-909e-28a1b4b91876 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:21.735237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 666/1316] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Nov 25 04:39:21 2021] POST /identity/v3/services => generated 246 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:39:24.106167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f84ff-25fd-4b2a-8f70-9016579c4e62 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.107042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f84ff-25fd-4b2a-8f70-9016579c4e62 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.107042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f84ff-25fd-4b2a-8f70-9016579c4e62 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.110128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 651/1317] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:24.117532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.118298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.118530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.137444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:24.138656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:24.164271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 667/1318] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:24 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:24.201785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f84ff-25fd-4b2a-8f70-9016579c4e62 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:24.224085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f84ff-25fd-4b2a-8f70-9016579c4e62 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:24.231238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:24.232643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.232933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.233237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.234142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:24.236600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:24.255077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 25 04:39:24.256917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 652/1319] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:39:24 2021] GET /identity/v3/services/placement => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:24.264346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:24.274146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331530f-3987-448c-af80-6bc389ce9cae None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:24.279635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:24.280344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.280631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.280919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.281676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:24.281995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:24.283663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:24.289561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 668/1320] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Nov 25 04:39:24 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:24.297264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:24.307729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5c0d7-4538-43b7-8c1f-48c0f4b0818a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:24.312603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:24.313274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.313562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.313826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.314632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] RBAC: Adding query filter params (interface=public, service_id=f269085e98af42388e46c7cc7ceb1083, region_id=RegionOne) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:24.314942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:24.316599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf0395-c33e-4830-90cd-e070164bf0ce admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:24.322015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 653/1321] 10.222.0.36 () {56 vars in 1272 bytes} [Thu Nov 25 04:39:24 2021] GET /identity/v3/endpoints?service_id=f269085e98af42388e46c7cc7ceb1083&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:39:24.328187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:24.338497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c61b-e2b0-4fc0-ac88-e55fc38018fb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:24.343598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:24.344292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:24.344569 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:24.344839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:24.345527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:24.347100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6eb89-82e2-442d-a75f-eb42d183837d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:24.354174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 669/1322] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:39:24 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:39:26.682983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb08b2-ab12-4c72-9774-876a9e5ef364 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:26.683809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb08b2-ab12-4c72-9774-876a9e5ef364 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:26.683809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb08b2-ab12-4c72-9774-876a9e5ef364 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:26.686964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 654/1323] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:39:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:39:26.693040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:26.693479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:26.693571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:26.713155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:39:26.714353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:39:26.723337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 670/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:39:26 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:39:26.748864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb08b2-ab12-4c72-9774-876a9e5ef364 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:26.766928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb08b2-ab12-4c72-9774-876a9e5ef364 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:26.775748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:26.776851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:26.777352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:26.777843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:26.778521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:26.780387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:26.795297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING keystone.server.flask.application [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 25 04:39:26.796544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 655/1325] 10.222.0.36 () {56 vars in 1138 bytes} [Thu Nov 25 04:39:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 25 04:39:26.804894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:26.815933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da47feb-0172-47cb-8fe7-e414e7768ace None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:26.824180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:26.825202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:26.825751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:26.826030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] PATH_INFO: `/v3/services` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:26.826782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:39:26.827095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:26.829681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415933d-1a60-4600-aaa6-53988fde6d88 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:26.838765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 671/1326] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Nov 25 04:39:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:39:26.846780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:39:26.857932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0570e-de54-4f35-a078-354dd22bcc77 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:39:26.864489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:39:26.865153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:39:26.865436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:39:26.865704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:39:26.866476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:39:26.868643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c34f1f-c150-4c4d-8b63-91a49e4a79a7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:39:26.891617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 656/1327] 10.222.0.36 () {60 vars in 1165 bytes} [Thu Nov 25 04:39:26 2021] POST /identity/v3/endpoints => generated 331 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:40:30.862190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:30.863460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:30.864286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:30.869739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 672/1328] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:30 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:40:30.875881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c66b-aaec-44c6-ae22-d0ce537f66f4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:30.876348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c66b-aaec-44c6-ae22-d0ce537f66f4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:30.876628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c66b-aaec-44c6-ae22-d0ce537f66f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:30.980085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5b38c66b-aaec-44c6-ae22-d0ce537f66f4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:30.981900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5b38c66b-aaec-44c6-ae22-d0ce537f66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:31.106229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 657/1329] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:40:31.130757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:31.132878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:31.295644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467430b-2924-4f5b-89e0-eef98d501106 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:31.390236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:31.390822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:31.391102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:31.391372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:31.392120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:31.394011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208da98-34df-40fb-a9cf-324ba71d15f2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:31.413313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 673/1330] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:40:31 2021] GET /identity/v3/projects => generated 2553 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:40:33.820812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509f30-8f90-419b-9d3e-b520ce2bc19e None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:33.821381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509f30-8f90-419b-9d3e-b520ce2bc19e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:33.821381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3509f30-8f90-419b-9d3e-b520ce2bc19e None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:33.823231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 658/1331] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:33.829442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae163f-d19e-43b9-8838-add9bb6c6c62 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:33.829876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae163f-d19e-43b9-8838-add9bb6c6c62 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:33.830061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae163f-d19e-43b9-8838-add9bb6c6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:33.912298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e0ae163f-d19e-43b9-8838-add9bb6c6c62 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:33.913630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e0ae163f-d19e-43b9-8838-add9bb6c6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:34.009461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 674/1332] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:34.060362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:34.060627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:34.060923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:34.062687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 659/1333] 10.222.0.36 () {54 vars in 964 bytes} [Thu Nov 25 04:40:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:34.068960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29320f4-c22e-45eb-890f-f2661d9e6a7c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:34.070147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29320f4-c22e-45eb-890f-f2661d9e6a7c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:34.070488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29320f4-c22e-45eb-890f-f2661d9e6a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:34.151264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c29320f4-c22e-45eb-890f-f2661d9e6a7c None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:34.152488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c29320f4-c22e-45eb-890f-f2661d9e6a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:34.227444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 675/1334] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Nov 25 04:40:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:34.237098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:34.238795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:34.340261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23c5ca-edda-46f1-a322-c40024a53ca3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:34.418333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:34.419530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:34.419909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:34.420075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:34.423441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:34.539406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:34.540881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ebed-2101-45c8-9dd8-f769372f12c4 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:34.558901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 660/1335] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:37.203273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cf71-8e12-49f4-8738-8d91b67f59c6 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:37.203828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cf71-8e12-49f4-8738-8d91b67f59c6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:37.203828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658cf71-8e12-49f4-8738-8d91b67f59c6 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:37.205716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 676/1336] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:37.211899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409ace-bd52-4c2d-bc3d-a7ac69124d5d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:37.212368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409ace-bd52-4c2d-bc3d-a7ac69124d5d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:37.212565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409ace-bd52-4c2d-bc3d-a7ac69124d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:37.281250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-31409ace-bd52-4c2d-bc3d-a7ac69124d5d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:37.282493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-31409ace-bd52-4c2d-bc3d-a7ac69124d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:37.381135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 661/1337] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:37.436740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:37.437002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:37.437280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:37.439231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 677/1338] 10.222.0.36 () {54 vars in 964 bytes} [Thu Nov 25 04:40:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:37.445730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde5f7-96cf-431f-91c2-5dd774be11f0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:37.446016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde5f7-96cf-431f-91c2-5dd774be11f0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:37.446293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde5f7-96cf-431f-91c2-5dd774be11f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:37.520774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-bcfde5f7-96cf-431f-91c2-5dd774be11f0 None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:37.521995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bcfde5f7-96cf-431f-91c2-5dd774be11f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:37.601642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 662/1339] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Nov 25 04:40:37 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:37.611152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:37.612814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:37.717388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aada7d-fcee-4114-bba1-b4b952b916ca None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:37.791173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:37.791815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:37.792090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:37.792407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:37.794017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:37.918309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:37.919658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8759ee-b725-4faf-8e11-f20881657c8b service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:37.938352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 678/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:40.851100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:40.851995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:40.852215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:40.855014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 663/1341] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:40.864852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:40.865666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:40.865878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:40.938502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:40.939690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:41.052966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 679/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:41.089303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:41.090856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:41.215042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70f00-2eb0-4239-a31c-32b406c5ba3f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:41.313093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:41.313957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:41.314239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:41.314507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:41.324369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:41.326414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0256f-1855-454c-9fb7-f5955cce71da admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:41.328102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 664/1343] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:40:41 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:40:41.341186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:41.342397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:41.444948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4faa5-4938-47cb-8aac-5bac523abf4b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:41.522448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:41.523299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:41.523699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:41.524077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:41.526805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:41.643197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:41.645470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ebbb8-929a-44ab-8b55-e1f6dbb64595 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:41.664433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 680/1344] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:44.737412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:44.738245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:44.738448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:44.741613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 665/1345] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:44.747732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:44.748233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:44.748336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:44.814532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:44.815750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:44.917944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 681/1346] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:44.968043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:44.969660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:45.111204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4729-0011-41a9-b068-099ac1602d54 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:45.215274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:45.216527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:45.216945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:45.217378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:45.231264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:45.233367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5ac0-3f2b-4bd3-9829-55a3749b145d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:45.235122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 666/1347] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:40:44 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:40:45.258747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:45.259983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:45.353477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4ff7-24c8-4167-918f-67f087400060 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:45.437518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:45.438171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:45.438450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:45.438724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:45.440421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:45.552679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:45.554197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cad15f-055d-49f2-a1cf-f08b7874f786 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:45.573761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 682/1348] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:48.873520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:48.874059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:48.874059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:48.875886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 667/1349] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:48.882092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f908b-7653-45aa-85e9-b9ca63cc245d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:48.882617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f908b-7653-45aa-85e9-b9ca63cc245d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:48.882704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f908b-7653-45aa-85e9-b9ca63cc245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:48.952388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-275f908b-7653-45aa-85e9-b9ca63cc245d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:48.953603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-275f908b-7653-45aa-85e9-b9ca63cc245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:49.055000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 683/1350] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:49.092991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:49.094500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:49.197979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bb35b-4d7e-4082-9529-f86f984bf015 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:49.277011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:49.277692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:49.278022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:49.278294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:49.279977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:49.390840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:49.392305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df931b3-99dc-4542-87df-71525597e214 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:49.410591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 668/1351] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:51.859646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:51.860222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:51.860222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:51.861887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 684/1352] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:51.868801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d4970-05fd-4b95-8bce-3860eba849f1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:51.869272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d4970-05fd-4b95-8bce-3860eba849f1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:51.869361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d4970-05fd-4b95-8bce-3860eba849f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:51.934119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-bc7d4970-05fd-4b95-8bce-3860eba849f1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:51.935332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bc7d4970-05fd-4b95-8bce-3860eba849f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:52.033017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 669/1353] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:52.071187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:52.072931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:52.185641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e38bb-626c-4687-94a4-00fcaf974f60 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:52.258153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:52.258805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:52.259079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:52.259345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:52.260992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:52.372004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:52.373458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61920acd-639e-4961-b96a-aedb1e4b71a0 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:52.392004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 685/1354] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:54.833163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:54.833741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:54.833741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:54.835593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 670/1355] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:54.841436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:54.841877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:54.841965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:54.910789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:54.911975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:55.011032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 686/1356] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:55.044924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:55.046482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:55.183225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf65a0-072e-4b45-8e31-ef052e1f8d7a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:55.277750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:55.278622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:55.278899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:55.279167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] PATH_INFO: `/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:55.290122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] RBAC: Authorizing `identity:get_project(project_id=1bfccf3a4b984f68b07f792b4eda21aa)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:55.292243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9de89-b7f1-4d03-ba0e-71b888a42a9d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:55.293974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 671/1357] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Nov 25 04:40:55 2021] GET /identity/v3/projects/1bfccf3a4b984f68b07f792b4eda21aa => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:40:55.306475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:55.307714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:55.405454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484304b-02c8-41b3-b23a-c75c8f725789 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:55.483268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:55.483956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:55.484278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:55.484557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:55.486217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:55.599451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:55.601119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab7a20-7431-46dc-8112-2f5730c6ee77 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:55.622061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 687/1358] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:40:58.307348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:58.307914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:58.307914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:58.309753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 672/1359] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:40:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:40:58.316754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20563-8694-4587-aa16-963f0430cd63 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:58.317445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20563-8694-4587-aa16-963f0430cd63 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:58.317599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee20563-8694-4587-aa16-963f0430cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:58.387693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3ee20563-8694-4587-aa16-963f0430cd63 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:40:58.388940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3ee20563-8694-4587-aa16-963f0430cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:58.493187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 688/1360] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:40:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:40:58.542502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:40:58.544046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:58.652301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c294955-6f6c-48a5-bbc2-eec206ff737e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:40:58.726198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:40:58.726872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:40:58.727156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:40:58.727429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:40:58.729195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:40:58.857544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:40:58.858914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33263-ba97-4e09-966b-8b669f76c0e5 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:40:58.880225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 673/1361] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:40:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:01.316532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:01.317095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:01.319065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:01.320949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 689/1362] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:01.337358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea91d3-96be-4c25-98b7-b53db4884e80 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:01.338084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea91d3-96be-4c25-98b7-b53db4884e80 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:01.338177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea91d3-96be-4c25-98b7-b53db4884e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:01.420349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5eea91d3-96be-4c25-98b7-b53db4884e80 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:01.421481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5eea91d3-96be-4c25-98b7-b53db4884e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:01.530387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 674/1363] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:41:01.581150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:01.583361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:01.682054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86e74b-cf13-4c67-b197-1a704c829797 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:01.685828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:01.686490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:01.686769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:01.687019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:01.696553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:01.697958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cfdc1-ec89-490f-8a8a-d37eed0b4843 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:01.709111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 690/1364] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:04.507142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854b77-4458-4626-a030-34f70ece5f00 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:04.507727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854b77-4458-4626-a030-34f70ece5f00 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:04.507727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854b77-4458-4626-a030-34f70ece5f00 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:04.510536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 675/1365] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:04.520064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ed28-a9bf-4e5a-8bb0-2ab1e5a82e45 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:04.520789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ed28-a9bf-4e5a-8bb0-2ab1e5a82e45 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:04.521110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ed28-a9bf-4e5a-8bb0-2ab1e5a82e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:04.541063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6502ed28-a9bf-4e5a-8bb0-2ab1e5a82e45 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:04.542253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6502ed28-a9bf-4e5a-8bb0-2ab1e5a82e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:04.552172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 691/1366] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:04.589981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854b77-4458-4626-a030-34f70ece5f00 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:04.602854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854b77-4458-4626-a030-34f70ece5f00 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:04.607290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:04.607959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:04.608287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:04.608563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:04.619352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:04.620850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c5d00-1947-4d54-99e6-077dc77f9e6a service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:04.630564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 676/1367] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:09.012549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:09.013086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:09.013086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:09.014821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 692/1368] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:09.020730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e400c-f5cc-4625-a805-debc855103f2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:09.021269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e400c-f5cc-4625-a805-debc855103f2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:09.021269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e400c-f5cc-4625-a805-debc855103f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:09.040074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-799e400c-f5cc-4625-a805-debc855103f2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:09.041326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-799e400c-f5cc-4625-a805-debc855103f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:09.049573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 677/1369] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:09.090370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:09.092088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:09.105033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8f23-12ac-41a3-adde-960668d7a108 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:09.108515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:09.109173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:09.109460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:09.109749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:09.122891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:09.124378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2615cf9-98ae-4f41-95d1-c323e5f27e97 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:09.134578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 693/1370] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:12.244206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d046101-06db-4426-b75b-740fd27ac0a0 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:12.244874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d046101-06db-4426-b75b-740fd27ac0a0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:12.244874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d046101-06db-4426-b75b-740fd27ac0a0 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:12.246672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 678/1371] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:12.253554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd6fe-1812-4218-abd2-b970208b432d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:12.254074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd6fe-1812-4218-abd2-b970208b432d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:12.254283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd6fe-1812-4218-abd2-b970208b432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:12.275553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8e2dd6fe-1812-4218-abd2-b970208b432d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:12.276803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8e2dd6fe-1812-4218-abd2-b970208b432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:12.285946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 694/1372] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:12.325071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d046101-06db-4426-b75b-740fd27ac0a0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:12.336791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d046101-06db-4426-b75b-740fd27ac0a0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:12.340445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:12.341096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:12.341382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:12.341660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:12.352829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:12.354306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b085dc-c724-409f-af3d-48202d655796 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:12.366078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 679/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:16.775357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8cfe1-adf2-4cc9-9da7-8975b9523b9b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:16.775908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8cfe1-adf2-4cc9-9da7-8975b9523b9b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:16.775908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8cfe1-adf2-4cc9-9da7-8975b9523b9b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:16.777619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 695/1374] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:16.783889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e364f-4df7-41a1-b818-e68d4fe39213 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:16.784403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e364f-4df7-41a1-b818-e68d4fe39213 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:16.784514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e364f-4df7-41a1-b818-e68d4fe39213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:16.803933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c25e364f-4df7-41a1-b818-e68d4fe39213 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:16.805204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c25e364f-4df7-41a1-b818-e68d4fe39213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:16.814457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 680/1375] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:16.854320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8cfe1-adf2-4cc9-9da7-8975b9523b9b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:16.866339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8cfe1-adf2-4cc9-9da7-8975b9523b9b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:16.870072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:16.870705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:16.870984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:16.871272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:16.880838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:16.882330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462b154-be84-41cb-b8bd-bed48561d8b4 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:16.894876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 696/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:21.880184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82d77-5bae-454c-8424-4c735fafd063 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:21.880184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82d77-5bae-454c-8424-4c735fafd063 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:21.880184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a82d77-5bae-454c-8424-4c735fafd063 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:21.880889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 681/1377] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:41:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:21.886177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbcfe-dfcc-45f1-b78b-f9b7236a91e2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:21.887257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbcfe-dfcc-45f1-b78b-f9b7236a91e2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:21.887828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbcfe-dfcc-45f1-b78b-f9b7236a91e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:21.995340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-25bfbcfe-dfcc-45f1-b78b-f9b7236a91e2 None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:21.996811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-25bfbcfe-dfcc-45f1-b78b-f9b7236a91e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:22.143656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 697/1378] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:41:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:26.306918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99904-4ca3-4f75-9362-9d5421c4244c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:26.307518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99904-4ca3-4f75-9362-9d5421c4244c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:26.307518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99904-4ca3-4f75-9362-9d5421c4244c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:26.309309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 682/1379] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:41:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:26.314941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be724-a7ee-484d-9755-0878246afdd9 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:26.315363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be724-a7ee-484d-9755-0878246afdd9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:26.315559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be724-a7ee-484d-9755-0878246afdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:26.335732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-224be724-a7ee-484d-9755-0878246afdd9 None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:26.337074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-224be724-a7ee-484d-9755-0878246afdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:26.347374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 698/1380] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:41:26 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:27.819734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde177d-9abb-454f-81d6-90fed53f6be0 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:27.820425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde177d-9abb-454f-81d6-90fed53f6be0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:27.820519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde177d-9abb-454f-81d6-90fed53f6be0 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:27.823327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 683/1381] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:41:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:27.829013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5af92-39df-4093-87c6-afe2df00cd6f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:27.829418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5af92-39df-4093-87c6-afe2df00cd6f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:27.829595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5af92-39df-4093-87c6-afe2df00cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:27.848355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-44e5af92-39df-4093-87c6-afe2df00cd6f None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:27.849786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-44e5af92-39df-4093-87c6-afe2df00cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:27.860061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 699/1382] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:41:27 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:41:31.792385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e7cf-dd39-4493-bc7d-cc5b4dbb4d87 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:31.792964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e7cf-dd39-4493-bc7d-cc5b4dbb4d87 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:31.792964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e7cf-dd39-4493-bc7d-cc5b4dbb4d87 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:31.794675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 684/1383] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:31.800522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd1d6b-5bc2-4570-88e2-48d1d26ebd95 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:31.800944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd1d6b-5bc2-4570-88e2-48d1d26ebd95 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:31.801045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd1d6b-5bc2-4570-88e2-48d1d26ebd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:31.819261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5ffd1d6b-5bc2-4570-88e2-48d1d26ebd95 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:31.820479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5ffd1d6b-5bc2-4570-88e2-48d1d26ebd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:31.828609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 700/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:31.879655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5936-44f0-4ce5-b764-37ef36dfa3ed None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:31.879940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5936-44f0-4ce5-b764-37ef36dfa3ed None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:31.880642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5936-44f0-4ce5-b764-37ef36dfa3ed None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:31.882421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 685/1385] 10.222.0.36 () {54 vars in 961 bytes} [Thu Nov 25 04:41:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:31.888605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2474-345f-47a0-97e3-a1e64a35f919 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:31.889038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2474-345f-47a0-97e3-a1e64a35f919 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:31.889421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b2474-345f-47a0-97e3-a1e64a35f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:31.940093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e84b2474-345f-47a0-97e3-a1e64a35f919 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:31.941452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e84b2474-345f-47a0-97e3-a1e64a35f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:32.027616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 701/1386] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Nov 25 04:41:31 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:32.036065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5936-44f0-4ce5-b764-37ef36dfa3ed None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:32.050463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5936-44f0-4ce5-b764-37ef36dfa3ed None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:32.056056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:32.056820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:32.057203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:32.057580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:32.065599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:32.067342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0778845-7304-4f8d-bd68-eea57a234f38 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:32.077172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 686/1387] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:34.685882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048d4e0-d8ed-4011-9b60-1ce662a2dbec None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:34.686439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048d4e0-d8ed-4011-9b60-1ce662a2dbec None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:34.686439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048d4e0-d8ed-4011-9b60-1ce662a2dbec None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:34.688866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 702/1388] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:34.694706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09fac6-d29c-4066-8d1a-c294be56e4e1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:34.695170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09fac6-d29c-4066-8d1a-c294be56e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:34.695274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09fac6-d29c-4066-8d1a-c294be56e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:34.714637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ec09fac6-d29c-4066-8d1a-c294be56e4e1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:34.715941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ec09fac6-d29c-4066-8d1a-c294be56e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:34.725272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 687/1389] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:34.772342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048d4e0-d8ed-4011-9b60-1ce662a2dbec None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:34.788613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048d4e0-d8ed-4011-9b60-1ce662a2dbec None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:34.794908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:34.795552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:34.795839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:34.796118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:34.804929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:34.807026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd3a1-ae8a-4f8a-9dd0-6abcfa933aaf service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:34.817870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 703/1390] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:37.489711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57305c2-61f7-4482-804e-af21a341a9dc None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:37.490245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57305c2-61f7-4482-804e-af21a341a9dc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:37.490370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57305c2-61f7-4482-804e-af21a341a9dc None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:37.492684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 688/1391] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:37.498704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ae4-9c81-4168-8084-d6e5f61e3c78 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:37.499391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ae4-9c81-4168-8084-d6e5f61e3c78 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:37.499391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ae4-9c81-4168-8084-d6e5f61e3c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:37.518933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-342d2ae4-9c81-4168-8084-d6e5f61e3c78 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:37.520566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-342d2ae4-9c81-4168-8084-d6e5f61e3c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:37.530278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 704/1392] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:37.581575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a2f5-7703-4d3b-bae4-c299cc3df8ee None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:37.582264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a2f5-7703-4d3b-bae4-c299cc3df8ee None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:37.582642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245a2f5-7703-4d3b-bae4-c299cc3df8ee None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:37.584553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 689/1393] 10.222.0.36 () {54 vars in 961 bytes} [Thu Nov 25 04:41:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:37.590858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c8b8-29df-4bde-b3cd-ae82acccd639 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:37.591286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c8b8-29df-4bde-b3cd-ae82acccd639 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:37.592087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c8b8-29df-4bde-b3cd-ae82acccd639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:37.612639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ed88c8b8-29df-4bde-b3cd-ae82acccd639 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:37.614470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ed88c8b8-29df-4bde-b3cd-ae82acccd639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:37.625608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 705/1394] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Nov 25 04:41:37 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:37.634459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245a2f5-7703-4d3b-bae4-c299cc3df8ee None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:37.654314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245a2f5-7703-4d3b-bae4-c299cc3df8ee None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:37.660028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:37.660964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:37.661376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:37.661944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:37.671354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:37.673662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2fd98-c02b-4bb9-afe9-21876d008271 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:37.688505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 690/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:39.905989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b102-e67b-4428-9b66-8fed9294858f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:39.907615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b102-e67b-4428-9b66-8fed9294858f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:39.907904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5b102-e67b-4428-9b66-8fed9294858f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:39.909940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 706/1396] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:39.916119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921290ff-d832-471d-91c8-45ff14a5eb83 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:39.916966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921290ff-d832-471d-91c8-45ff14a5eb83 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:39.917252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921290ff-d832-471d-91c8-45ff14a5eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:39.936426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-921290ff-d832-471d-91c8-45ff14a5eb83 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:39.937634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-921290ff-d832-471d-91c8-45ff14a5eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:39.946493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 691/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:40.000584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b7d2-c092-4f44-9f5e-9860656e523b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.000843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b7d2-c092-4f44-9f5e-9860656e523b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.001318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b7d2-c092-4f44-9f5e-9860656e523b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.003116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 707/1398] 10.222.0.36 () {54 vars in 963 bytes} [Thu Nov 25 04:41:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:40.008846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9479-6ea3-48d0-9cee-7a1e8ccd3c55 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.009311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9479-6ea3-48d0-9cee-7a1e8ccd3c55 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.009761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9479-6ea3-48d0-9cee-7a1e8ccd3c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.060063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ff7f9479-6ea3-48d0-9cee-7a1e8ccd3c55 None None] MFA Rules not processed for user `140bf1d478d74252a94ab359064731dd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:40.061549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ff7f9479-6ea3-48d0-9cee-7a1e8ccd3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:40.124857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 692/1399] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Nov 25 04:41:40 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:40.133484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832b7d2-c092-4f44-9f5e-9860656e523b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:40.144681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832b7d2-c092-4f44-9f5e-9860656e523b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:40.148686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:40.149343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.149622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.149980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.151571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fc32-2631-4459-8876-a0cd0b1f77a2 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.151850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fc32-2631-4459-8876-a0cd0b1f77a2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.152119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fc32-2631-4459-8876-a0cd0b1f77a2 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.154102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 693/1400] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:41:40.159497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356556b-370b-4c39-b0f6-1d137043476a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.160281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356556b-370b-4c39-b0f6-1d137043476a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.160281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356556b-370b-4c39-b0f6-1d137043476a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.162667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:40.164129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:40.178571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 708/1401] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:40.181291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e356556b-370b-4c39-b0f6-1d137043476a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:40.182592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e356556b-370b-4c39-b0f6-1d137043476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:40.192267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 694/1402] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:40.236356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:40.249437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01247-46fd-497e-add0-b227726eb537 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:40.255850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:40.256656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:40.257020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:40.257392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:40.266132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:40.267798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc225d-804e-4be6-90e2-78e4d7b6dcbe service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:40.278169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 709/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:42.681329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644a5-18ba-4aea-9c46-1a6b86fde848 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:42.682312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644a5-18ba-4aea-9c46-1a6b86fde848 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:42.682789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644a5-18ba-4aea-9c46-1a6b86fde848 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:42.685128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 695/1404] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:42.692480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bee38-b298-43c7-915d-d39e591379bf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:42.692942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bee38-b298-43c7-915d-d39e591379bf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:42.693072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bee38-b298-43c7-915d-d39e591379bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:42.715641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-788bee38-b298-43c7-915d-d39e591379bf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:42.716888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-788bee38-b298-43c7-915d-d39e591379bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:42.727183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 710/1405] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:42.783343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920644a5-18ba-4aea-9c46-1a6b86fde848 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:42.799012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920644a5-18ba-4aea-9c46-1a6b86fde848 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:42.804623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:42.805300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:42.805574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:42.805843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:42.813882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:42.815476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d13865-62d4-4cbb-a5e4-07c4bea348c8 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:42.825495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 696/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:45.255975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8ce9-82c3-4b5f-92fd-d883c66cd3ee None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:45.256531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8ce9-82c3-4b5f-92fd-d883c66cd3ee None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:45.256531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8ce9-82c3-4b5f-92fd-d883c66cd3ee None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:45.258283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 711/1407] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:45.264394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dda7-2cfb-47c2-ac4b-0642aa4e3ac5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:45.264832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dda7-2cfb-47c2-ac4b-0642aa4e3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:45.264924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dda7-2cfb-47c2-ac4b-0642aa4e3ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:45.283099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fc96dda7-2cfb-47c2-ac4b-0642aa4e3ac5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:45.284289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fc96dda7-2cfb-47c2-ac4b-0642aa4e3ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:45.292595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 697/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:45.340201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8ce9-82c3-4b5f-92fd-d883c66cd3ee None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:45.356250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8ce9-82c3-4b5f-92fd-d883c66cd3ee None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:45.362447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:45.363557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:45.364129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:45.364590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:45.374012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:45.375745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af07f29-2be6-4dbf-83a7-b7ed491871ab service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:45.387366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 712/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:48.079396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787c4-aa13-416c-aaf3-dafaeccfff52 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:48.080005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787c4-aa13-416c-aaf3-dafaeccfff52 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:48.080005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3787c4-aa13-416c-aaf3-dafaeccfff52 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:48.081882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 698/1410] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:48.088708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b00d5-aa6e-4922-9d10-d1912fdd7ec7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:48.089221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b00d5-aa6e-4922-9d10-d1912fdd7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:48.089323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b00d5-aa6e-4922-9d10-d1912fdd7ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:48.108867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f36b00d5-aa6e-4922-9d10-d1912fdd7ec7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:48.110121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f36b00d5-aa6e-4922-9d10-d1912fdd7ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:48.119414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 713/1411] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:48.177840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3787c4-aa13-416c-aaf3-dafaeccfff52 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:48.194054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3787c4-aa13-416c-aaf3-dafaeccfff52 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:48.200052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:48.200753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:48.201049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:48.201326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:48.210756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:48.212514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759af8a4-c56f-4bbe-8b2b-f2e168ac1440 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:48.222499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 699/1412] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:50.954107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adec75-49de-4e2a-9763-8448905827b9 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:50.954646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adec75-49de-4e2a-9763-8448905827b9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:50.954646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adec75-49de-4e2a-9763-8448905827b9 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:50.957025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 714/1413] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:50.963297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b71d-717c-4bb4-a126-0ab75c632ea1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:50.963853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b71d-717c-4bb4-a126-0ab75c632ea1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:50.963853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9b71d-717c-4bb4-a126-0ab75c632ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:50.983674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4ca9b71d-717c-4bb4-a126-0ab75c632ea1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:50.984904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4ca9b71d-717c-4bb4-a126-0ab75c632ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:50.994601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 700/1414] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:51.044965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adec75-49de-4e2a-9763-8448905827b9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:51.061256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adec75-49de-4e2a-9763-8448905827b9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:51.067780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:51.068515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:51.068796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:51.069070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:51.077888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:51.079552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afc9ed-19f3-494e-bbfa-5996009e77ad service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:51.089732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 715/1415] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:53.737161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e54e-009f-42de-b401-102b4c6a3f9a None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:53.737730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e54e-009f-42de-b401-102b4c6a3f9a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:53.737730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e54e-009f-42de-b401-102b4c6a3f9a None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:53.740022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 701/1416] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:53.746073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aaca7-aa8a-4d07-9b75-9a48659e5151 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:53.746576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aaca7-aa8a-4d07-9b75-9a48659e5151 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:53.746671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aaca7-aa8a-4d07-9b75-9a48659e5151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:53.765188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-aa6aaca7-aa8a-4d07-9b75-9a48659e5151 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:53.766395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-aa6aaca7-aa8a-4d07-9b75-9a48659e5151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:53.775468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 716/1417] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:53.822435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e54e-009f-42de-b401-102b4c6a3f9a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:53.837986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e54e-009f-42de-b401-102b4c6a3f9a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:53.843589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:53.844254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:53.844544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:53.844817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:53.853287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:53.854899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea094c9-c580-4ae3-8ae5-859a5161f305 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:53.864884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 702/1418] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:55.299230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19d73-1e53-4873-8118-175e0e38c751 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:55.299796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19d73-1e53-4873-8118-175e0e38c751 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:55.299796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc19d73-1e53-4873-8118-175e0e38c751 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:55.301820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 717/1419] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:55.307760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8034e-edf5-4b64-9035-e7f8cad7539b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:55.308265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8034e-edf5-4b64-9035-e7f8cad7539b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:55.308378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8034e-edf5-4b64-9035-e7f8cad7539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:55.326965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-dae8034e-edf5-4b64-9035-e7f8cad7539b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:55.328205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-dae8034e-edf5-4b64-9035-e7f8cad7539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:55.336800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 703/1420] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:55.394365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693827a-c19a-403e-8de1-34069959d063 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:55.394623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693827a-c19a-403e-8de1-34069959d063 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:55.394905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693827a-c19a-403e-8de1-34069959d063 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:55.397090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 718/1421] 10.222.0.36 () {54 vars in 962 bytes} [Thu Nov 25 04:41:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:55.403872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba49c8-24d1-43dd-a701-020c06134bb8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:55.404427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba49c8-24d1-43dd-a701-020c06134bb8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:55.404921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba49c8-24d1-43dd-a701-020c06134bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:55.456896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-70ba49c8-24d1-43dd-a701-020c06134bb8 None None] MFA Rules not processed for user `c7db691378f74f4f8792b779ca0181f1`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:55.458045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-70ba49c8-24d1-43dd-a701-020c06134bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:55.523329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 704/1422] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Nov 25 04:41:55 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:55.531720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693827a-c19a-403e-8de1-34069959d063 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:55.543795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693827a-c19a-403e-8de1-34069959d063 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:55.547844 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:55.548535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:55.548806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:55.549088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:55.558855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:55.560357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f849a19-ab31-4ddc-852f-6aae4f7dd372 service glance] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:55.571004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 719/1423] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:56.074351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9faf-ceaf-4655-a11a-2d1bcf83110e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.074552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9faf-ceaf-4655-a11a-2d1bcf83110e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.074818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9faf-ceaf-4655-a11a-2d1bcf83110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.124075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f8ef9faf-ceaf-4655-a11a-2d1bcf83110e None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:56.125330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f8ef9faf-ceaf-4655-a11a-2d1bcf83110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:56.189779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 705/1424] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:41:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:56.232455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510d24-1546-4cc8-96ce-920c92aef4ab None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.232768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510d24-1546-4cc8-96ce-920c92aef4ab None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.233039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510d24-1546-4cc8-96ce-920c92aef4ab None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.234916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 720/1425] 10.222.0.36 () {54 vars in 942 bytes} [Thu Nov 25 04:41:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:56.242824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.243117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.243412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.298651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] MFA Rules not processed for user `86de70eda88d4d4ea1fdd4bc96bc6ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:56.299841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:56.309291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11788b-5012-4a95-b490-1fab545b9872 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.309835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11788b-5012-4a95-b490-1fab545b9872 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.309931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11788b-5012-4a95-b490-1fab545b9872 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.312236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 721/1426] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:56.317961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.318268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.318542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.336527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:56.337665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:56.345635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 722/1427] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:41:56.373467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 706/1428] 10.222.0.36 () {58 vars in 1039 bytes} [Thu Nov 25 04:41:56 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:56.383832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:56.392674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:56.395863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1b8d-51a1-4b52-af2d-75af79c70044 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:56.401262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:56.402009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.402304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.402572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.404366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21d015-0ca3-4662-8213-32a59e7ad24d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:56.411794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:56.413040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:56.413419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c428160-1fd6-4d53-928b-c1aead5fff92 service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:56.413699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:56.413983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:56.414248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:56.421678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 723/1429] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:41:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:41:56.422614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:56.424273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba70877-88a5-4b4f-b83c-d672e8050d3e service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:56.434316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 707/1430] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:41:58.859741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fff8-8a4a-4d1b-8cc4-4118906d3ba8 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:58.860325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fff8-8a4a-4d1b-8cc4-4118906d3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:58.860325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792fff8-8a4a-4d1b-8cc4-4118906d3ba8 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:58.862072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 724/1431] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:41:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:41:58.868829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed1f2-015b-4f94-ab40-78773bea637c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:58.869649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed1f2-015b-4f94-ab40-78773bea637c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:58.870072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed1f2-015b-4f94-ab40-78773bea637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:58.890115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-99fed1f2-015b-4f94-ab40-78773bea637c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:41:58.891332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-99fed1f2-015b-4f94-ab40-78773bea637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:41:58.900947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 708/1432] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:41:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:41:58.949553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792fff8-8a4a-4d1b-8cc4-4118906d3ba8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:41:58.967884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792fff8-8a4a-4d1b-8cc4-4118906d3ba8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:41:58.973906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:41:58.974997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:41:58.975285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:41:58.975564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:41:58.984660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:41:58.986683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ba87-fb09-4e73-b213-1c97d4767e88 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:41:58.998418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 725/1433] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:41:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:01.445656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dfde-9115-47ff-bb2f-d899bd49e123 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:01.446198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dfde-9115-47ff-bb2f-d899bd49e123 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:01.446198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4dfde-9115-47ff-bb2f-d899bd49e123 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:01.448058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 709/1434] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:42:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:01.453861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36d7-6415-4a37-9828-c5c90cb6e557 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:01.454306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36d7-6415-4a37-9828-c5c90cb6e557 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:01.454402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a36d7-6415-4a37-9828-c5c90cb6e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:01.476410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-671a36d7-6415-4a37-9828-c5c90cb6e557 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:01.477693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-671a36d7-6415-4a37-9828-c5c90cb6e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:01.496656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 726/1435] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:42:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:42:01.537094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4dfde-9115-47ff-bb2f-d899bd49e123 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:01.552118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4dfde-9115-47ff-bb2f-d899bd49e123 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:01.557512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:01.558180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:01.558485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:01.558741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:01.570133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:01.571775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4a5bc-20b1-4c47-b0a9-80743c5d339d service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:01.581851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 710/1436] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:19.327012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4d7d-eedd-4f0b-9b74-d69df921ce5b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:19.327656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4d7d-eedd-4f0b-9b74-d69df921ce5b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:19.327656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d4d7d-eedd-4f0b-9b74-d69df921ce5b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:19.329397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 727/1437] 10.222.0.36 () {54 vars in 918 bytes} [Thu Nov 25 04:42:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:19.337097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97598-1e90-4e3c-ad79-50fa1c48e537 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:19.337533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97598-1e90-4e3c-ad79-50fa1c48e537 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:19.337745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97598-1e90-4e3c-ad79-50fa1c48e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:19.357895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b5d97598-1e90-4e3c-ad79-50fa1c48e537 None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:19.359069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b5d97598-1e90-4e3c-ad79-50fa1c48e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:19.368766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 711/1438] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Nov 25 04:42:19 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:19.384052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05ff5-bd98-44e5-94d9-d75223d169b4 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:19.384342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05ff5-bd98-44e5-94d9-d75223d169b4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:19.384614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc05ff5-bd98-44e5-94d9-d75223d169b4 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:19.386446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 728/1439] 10.222.0.36 () {54 vars in 918 bytes} [Thu Nov 25 04:42:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:19.391716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191448d-459e-43d5-abf5-9b932a4eaf3a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:19.392010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191448d-459e-43d5-abf5-9b932a4eaf3a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:19.392320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191448d-459e-43d5-abf5-9b932a4eaf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:19.411752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f191448d-459e-43d5-abf5-9b932a4eaf3a None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:19.413132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f191448d-459e-43d5-abf5-9b932a4eaf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:19.423623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 712/1440] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Nov 25 04:42:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:22.213387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6daf-5a45-454b-8ce9-3ff46b08d6d8 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:22.214013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6daf-5a45-454b-8ce9-3ff46b08d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:22.214013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6daf-5a45-454b-8ce9-3ff46b08d6d8 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:22.215749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:42:22.222891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc74e-a387-492d-8c3e-b33211e5f215 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:22.223335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc74e-a387-492d-8c3e-b33211e5f215 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:22.223442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc74e-a387-492d-8c3e-b33211e5f215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:22.243242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b2adc74e-a387-492d-8c3e-b33211e5f215 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:22.244473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b2adc74e-a387-492d-8c3e-b33211e5f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:22.253609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:22.303184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6daf-5a45-454b-8ce9-3ff46b08d6d8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:22.319741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6daf-5a45-454b-8ce9-3ff46b08d6d8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:22.326502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:22.327257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:22.327565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:22.327833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:22.336901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:22.338527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a7bde-4f2d-412b-92f2-61c1746a74fd service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:22.348397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 730/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:23.936806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92574-dc07-435f-a835-080720d71f13 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:23.937402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92574-dc07-435f-a835-080720d71f13 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:23.937402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92574-dc07-435f-a835-080720d71f13 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:23.939139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:23.948665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd65f-f9bb-4c6d-8cc5-943a8adfca1e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:23.949439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd65f-f9bb-4c6d-8cc5-943a8adfca1e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:23.949619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd65f-f9bb-4c6d-8cc5-943a8adfca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:23.972854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-264fd65f-f9bb-4c6d-8cc5-943a8adfca1e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:23.974107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-264fd65f-f9bb-4c6d-8cc5-943a8adfca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:23.984869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:24.143270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe92574-dc07-435f-a835-080720d71f13 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:24.162207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe92574-dc07-435f-a835-080720d71f13 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:24.168467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:24.169121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:24.169401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:24.169670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:24.178204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:24.179843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c999eb0-e180-423c-ba0f-59f1cf4762c4 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:24.189600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 715/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:25.750506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084137-6412-4b24-ba1c-25d794797453 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:25.751074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084137-6412-4b24-ba1c-25d794797453 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:25.751074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084137-6412-4b24-ba1c-25d794797453 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:25.753732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:25 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:25.760773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25d41-30fd-4ab7-a767-004c9cafbe06 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:25.761771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25d41-30fd-4ab7-a767-004c9cafbe06 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:25.762050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25d41-30fd-4ab7-a767-004c9cafbe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:25.782018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-57a25d41-30fd-4ab7-a767-004c9cafbe06 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:25.783204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-57a25d41-30fd-4ab7-a767-004c9cafbe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:25.793345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:25.948218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084137-6412-4b24-ba1c-25d794797453 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:25.973812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084137-6412-4b24-ba1c-25d794797453 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:25.980710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:25.981361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:25.981643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:25.981981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:25.991255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:25.992875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f0e68-d4e5-4d67-a904-3b607658bd1f service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:26.002720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 733/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:27.540975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d1b55-e052-4616-9aa1-0c1c9915fbe9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:27.541604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d1b55-e052-4616-9aa1-0c1c9915fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:27.541604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d1b55-e052-4616-9aa1-0c1c9915fbe9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:27.544648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:27.553648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87570f3-c447-45da-b8d4-7b1b50d9a1f1 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:27.554142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87570f3-c447-45da-b8d4-7b1b50d9a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:27.554253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87570f3-c447-45da-b8d4-7b1b50d9a1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:27.573696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d87570f3-c447-45da-b8d4-7b1b50d9a1f1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:27.574923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d87570f3-c447-45da-b8d4-7b1b50d9a1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:27.583171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:42:27.744508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d1b55-e052-4616-9aa1-0c1c9915fbe9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:27.764924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d1b55-e052-4616-9aa1-0c1c9915fbe9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:27.774760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:27.775437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:27.775741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:27.776034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:27.785700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:27.787316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddffa5-c31f-47b2-9d22-ea6d16fbfbaa service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:27.796898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 718/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:29.328059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fddd0-2574-4311-b4fc-1e1a0a147d57 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:29.328684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fddd0-2574-4311-b4fc-1e1a0a147d57 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:29.328684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fddd0-2574-4311-b4fc-1e1a0a147d57 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:29.331547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:29.340771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d97f-b421-456a-b7f8-9f7de8fe4fd5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:29.341134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d97f-b421-456a-b7f8-9f7de8fe4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:29.341234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910d97f-b421-456a-b7f8-9f7de8fe4fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:29.369687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3910d97f-b421-456a-b7f8-9f7de8fe4fd5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:29.371275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3910d97f-b421-456a-b7f8-9f7de8fe4fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:29.381249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:29.538519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fddd0-2574-4311-b4fc-1e1a0a147d57 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:29.555219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fddd0-2574-4311-b4fc-1e1a0a147d57 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:29.561760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:29.562401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:29.562680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:29.562953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:29.571985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:29.573619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bd94-6c96-4813-9e39-172b54b20846 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:29.583465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 736/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:42:31.053235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0ba6-a85f-409e-8eae-8da90d834c03 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:31.054153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0ba6-a85f-409e-8eae-8da90d834c03 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:31.054153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0ba6-a85f-409e-8eae-8da90d834c03 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:31.056966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:31.063579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333308e-7cf3-4db7-a980-59cd2cd439cb None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:31.064040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333308e-7cf3-4db7-a980-59cd2cd439cb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:31.064192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333308e-7cf3-4db7-a980-59cd2cd439cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:31.083798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3333308e-7cf3-4db7-a980-59cd2cd439cb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:31.085039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3333308e-7cf3-4db7-a980-59cd2cd439cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:31.093422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:31.261196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0ba6-a85f-409e-8eae-8da90d834c03 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:31.277668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0ba6-a85f-409e-8eae-8da90d834c03 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:31.284299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:31.284951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:31.285232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:31.285505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:31.294048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:31.295580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549ab7f-7bb2-40ab-bcc8-d7712c6400f6 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:31.305406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 721/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:32.796555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f4da-cbd9-4a23-9fda-fdef59245edc None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:32.797121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f4da-cbd9-4a23-9fda-fdef59245edc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:32.797121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f4da-cbd9-4a23-9fda-fdef59245edc None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:32.799012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:32.805690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ceb96-5531-4ae2-897d-37783c204db8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:32.806336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ceb96-5531-4ae2-897d-37783c204db8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:32.806501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ceb96-5531-4ae2-897d-37783c204db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:32.833925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8b3ceb96-5531-4ae2-897d-37783c204db8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:32.835186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8b3ceb96-5531-4ae2-897d-37783c204db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:32.844587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:33.001798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21f4da-cbd9-4a23-9fda-fdef59245edc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:33.025352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21f4da-cbd9-4a23-9fda-fdef59245edc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:33.032355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:33.033031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:33.033306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:33.033587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:33.042557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:33.044126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cd7fc-cdff-4a94-9fa8-7a01cfe7a700 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:33.053733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 739/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:34.543465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2993-8e91-4b1f-bbd5-3c707c852715 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:34.544514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2993-8e91-4b1f-bbd5-3c707c852715 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:34.544514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce2993-8e91-4b1f-bbd5-3c707c852715 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:34.547069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:34 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:34.554257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c91b-7db1-4fbb-a7af-4dcf0165eefb None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:34.554724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c91b-7db1-4fbb-a7af-4dcf0165eefb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:34.554830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c91b-7db1-4fbb-a7af-4dcf0165eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:34.579628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-eea7c91b-7db1-4fbb-a7af-4dcf0165eefb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:34.581477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-eea7c91b-7db1-4fbb-a7af-4dcf0165eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:34.592205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:34.745779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2993-8e91-4b1f-bbd5-3c707c852715 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:34.766473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce2993-8e91-4b1f-bbd5-3c707c852715 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:34.773638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:34.774273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:34.774552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:34.774825 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:34.783396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:34.785026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc188738-fd95-4aa9-a751-dd0bb8fd2596 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:34.795485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 724/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:36.288224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d10-932f-4d67-b107-7d6d29cf0657 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:36.288864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d10-932f-4d67-b107-7d6d29cf0657 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:36.288864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc5d10-932f-4d67-b107-7d6d29cf0657 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:36.290830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:42:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:36.296824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dade5-c8dd-459c-b930-6ff8bf6fac79 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:36.297275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dade5-c8dd-459c-b930-6ff8bf6fac79 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:36.297381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dade5-c8dd-459c-b930-6ff8bf6fac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:36.317439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3b3dade5-c8dd-459c-b930-6ff8bf6fac79 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:36.318648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3b3dade5-c8dd-459c-b930-6ff8bf6fac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:36.327732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:42:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:36.486502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc5d10-932f-4d67-b107-7d6d29cf0657 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:36.511050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc5d10-932f-4d67-b107-7d6d29cf0657 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:36.519059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:36.519710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:36.519995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:36.520303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:36.529529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:36.531128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f6a9e-8490-4b55-b9a0-c9b700f722d9 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:36.540800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 742/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:38.786768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf77e-b56a-42fd-a707-1799fd19d9a9 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:38.787355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf77e-b56a-42fd-a707-1799fd19d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:38.787355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf77e-b56a-42fd-a707-1799fd19d9a9 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:38.789194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:38.796387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a14e-0d28-4067-a916-e9b831c59749 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:38.796863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a14e-0d28-4067-a916-e9b831c59749 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:38.796969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5a14e-0d28-4067-a916-e9b831c59749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:38.818556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-52d5a14e-0d28-4067-a916-e9b831c59749 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:38.819807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-52d5a14e-0d28-4067-a916-e9b831c59749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:38.830421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:38.876216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baf77e-b56a-42fd-a707-1799fd19d9a9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:38.894170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baf77e-b56a-42fd-a707-1799fd19d9a9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:38.899878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:38.900554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:38.900835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:38.901105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:38.910908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:38.912377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f2f5a-9240-4210-bc0e-cd480b8d2aec service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:38.922212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 727/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:41.451602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bd93-40bf-4b18-962c-60d4b7616612 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:41.452243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bd93-40bf-4b18-962c-60d4b7616612 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:41.452243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3bd93-40bf-4b18-962c-60d4b7616612 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:41.453997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 744/1471] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:41.461332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28705-cc12-4e94-a127-23c70d652c11 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:41.462036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28705-cc12-4e94-a127-23c70d652c11 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:41.462366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e28705-cc12-4e94-a127-23c70d652c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:41.486059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f2e28705-cc12-4e94-a127-23c70d652c11 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:41.487261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f2e28705-cc12-4e94-a127-23c70d652c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:41.496665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 728/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:41.537451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3bd93-40bf-4b18-962c-60d4b7616612 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:41.548818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3bd93-40bf-4b18-962c-60d4b7616612 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:41.552757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:41.553392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:41.553674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:41.554019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:41.563558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:41.565042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1be5f-e093-4c7c-9ce3-c9c02a3be0de service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:41.575466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 745/1473] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:42:44.318916 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e078d-a0a6-46af-82d4-6ec0c62f7229 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:44.319518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e078d-a0a6-46af-82d4-6ec0c62f7229 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:44.319518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e078d-a0a6-46af-82d4-6ec0c62f7229 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:44.321463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 729/1474] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:44.328631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f294-5fb2-410a-a5bc-96aa6e822bc7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:44.329321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f294-5fb2-410a-a5bc-96aa6e822bc7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:44.329572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5f294-5fb2-410a-a5bc-96aa6e822bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:44.351213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-49e5f294-5fb2-410a-a5bc-96aa6e822bc7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:44.352441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-49e5f294-5fb2-410a-a5bc-96aa6e822bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:44.362119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 746/1475] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:44.406128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e078d-a0a6-46af-82d4-6ec0c62f7229 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:44.420642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e078d-a0a6-46af-82d4-6ec0c62f7229 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:44.424583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:44.425226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:44.425501 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:44.425770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:44.435440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:44.436926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36910c57-05f9-4bfc-8512-45cb3242fcc8 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:44.446811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 730/1476] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:46.938214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666600ce-7195-47fd-bbb5-e550c8d1c391 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:46.939053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666600ce-7195-47fd-bbb5-e550c8d1c391 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:46.939053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666600ce-7195-47fd-bbb5-e550c8d1c391 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:46.941957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 747/1477] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:46.948736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b467ca-e587-45a3-b118-5baf2dcf5b5d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:46.949204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b467ca-e587-45a3-b118-5baf2dcf5b5d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:46.949363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b467ca-e587-45a3-b118-5baf2dcf5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:46.976643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-12b467ca-e587-45a3-b118-5baf2dcf5b5d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:46.977835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-12b467ca-e587-45a3-b118-5baf2dcf5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:46.986405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 731/1478] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:47.031030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666600ce-7195-47fd-bbb5-e550c8d1c391 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:47.044765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666600ce-7195-47fd-bbb5-e550c8d1c391 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:47.049790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:47.050432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:47.050713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:47.050995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:47.060881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:47.062421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8162729-3d49-4ed4-b5d4-f0d4f51f8576 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:47.071955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 748/1479] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:49.588391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6031d-632d-4403-9102-6418fbd070f6 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:49.588894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6031d-632d-4403-9102-6418fbd070f6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:49.588894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6031d-632d-4403-9102-6418fbd070f6 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:49.590751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 732/1480] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:49.596909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d441-0b86-4c2c-a9cd-82036ddff6f9 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:49.597370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d441-0b86-4c2c-a9cd-82036ddff6f9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:49.597463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d441-0b86-4c2c-a9cd-82036ddff6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:49.617545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2a51d441-0b86-4c2c-a9cd-82036ddff6f9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:49.618645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2a51d441-0b86-4c2c-a9cd-82036ddff6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:49.627019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 749/1481] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:49.670351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6031d-632d-4403-9102-6418fbd070f6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:49.690163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6031d-632d-4403-9102-6418fbd070f6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:49.696368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:49.697027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:49.697338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:49.697585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:49.707635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:49.709128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040aeef-9515-4368-bbe5-434d0a8e81a0 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:49.719453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 733/1482] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:52.177262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a89e-fc99-464b-bc9e-b819d77a7380 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:52.177898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a89e-fc99-464b-bc9e-b819d77a7380 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:52.177898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87a89e-fc99-464b-bc9e-b819d77a7380 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:52.180915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 750/1483] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:52.190557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65fa72-a24c-4f19-899e-6eb61d9bbeb4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:52.190967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65fa72-a24c-4f19-899e-6eb61d9bbeb4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:52.191158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65fa72-a24c-4f19-899e-6eb61d9bbeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:52.211444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2a65fa72-a24c-4f19-899e-6eb61d9bbeb4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:52.212726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2a65fa72-a24c-4f19-899e-6eb61d9bbeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:52.224572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 734/1484] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:52.270080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87a89e-fc99-464b-bc9e-b819d77a7380 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:52.283180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87a89e-fc99-464b-bc9e-b819d77a7380 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:52.289757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:52.290687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:52.291059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:52.291406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:52.302473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:52.304061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17117024-f6c1-40e5-a90b-fd68001f7f6f service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:52.313677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 751/1485] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:54.752651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009326-572d-4924-a202-0527594f131f None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:54.753249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009326-572d-4924-a202-0527594f131f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:54.753249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009326-572d-4924-a202-0527594f131f None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:54.755007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 735/1486] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:54.761627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72bf1-3046-4a62-a6af-c5f8d3c94cbf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:54.762074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72bf1-3046-4a62-a6af-c5f8d3c94cbf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:54.762181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed72bf1-3046-4a62-a6af-c5f8d3c94cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:54.782699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-eed72bf1-3046-4a62-a6af-c5f8d3c94cbf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:54.783880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-eed72bf1-3046-4a62-a6af-c5f8d3c94cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:54.793002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 752/1487] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:54.832008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009326-572d-4924-a202-0527594f131f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:54.848389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009326-572d-4924-a202-0527594f131f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:54.855894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:54.856962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:54.857411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:54.857866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:54.871478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:54.872991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b344cf-8151-455a-9c43-b4c024b6312a service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:54.882908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 736/1488] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:57.320001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f59f-1845-4091-8249-d1645199078d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:57.320640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f59f-1845-4091-8249-d1645199078d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:57.320640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7f59f-1845-4091-8249-d1645199078d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:57.322419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 753/1489] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:57.329558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681029-4f60-48a7-af88-6a14bf6851fc None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:57.330267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681029-4f60-48a7-af88-6a14bf6851fc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:57.330519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681029-4f60-48a7-af88-6a14bf6851fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:57.358486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-91681029-4f60-48a7-af88-6a14bf6851fc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:57.359687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-91681029-4f60-48a7-af88-6a14bf6851fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:57.369248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 737/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:57.409199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f59f-1845-4091-8249-d1645199078d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:57.420852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7f59f-1845-4091-8249-d1645199078d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:57.424351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:57.424993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:57.425270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:57.425545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:57.434574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:57.436001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9132461-b53b-4cb1-8c18-b43f6e20ee4c service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:57.445380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 754/1491] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:42:59.832698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f941-a7cc-47ae-812d-839b4fefa83d None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:59.833329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f941-a7cc-47ae-812d-839b4fefa83d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:59.833329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f941-a7cc-47ae-812d-839b4fefa83d None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:59.835283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 738/1492] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:42:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:42:59.842296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494351d-d4a9-43e6-b37e-4ee1a67a260f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:59.842778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494351d-d4a9-43e6-b37e-4ee1a67a260f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:59.842886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494351d-d4a9-43e6-b37e-4ee1a67a260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:59.864895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8494351d-d4a9-43e6-b37e-4ee1a67a260f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:42:59.866075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8494351d-d4a9-43e6-b37e-4ee1a67a260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:42:59.875425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 755/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:42:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:42:59.917123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54f941-a7cc-47ae-812d-839b4fefa83d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:42:59.933117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54f941-a7cc-47ae-812d-839b4fefa83d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:42:59.937497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:42:59.938152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:42:59.938429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:42:59.938702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:42:59.947775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:42:59.949252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5794f-c5e4-413d-9471-9533640353ec service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:42:59.958417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 739/1494] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:42:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:43:02.329147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d97d0-8cc4-402f-b7be-5d799065663a None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:02.330069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d97d0-8cc4-402f-b7be-5d799065663a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:02.330069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d97d0-8cc4-402f-b7be-5d799065663a None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:02.333054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 756/1495] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:43:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:02.341817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3149-b79d-41c8-9754-6e3ed726c230 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:02.342252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3149-b79d-41c8-9754-6e3ed726c230 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:02.342379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3149-b79d-41c8-9754-6e3ed726c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:02.365427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b4ca3149-b79d-41c8-9754-6e3ed726c230 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:02.366697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b4ca3149-b79d-41c8-9754-6e3ed726c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:02.376112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 740/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:43:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:02.416313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d97d0-8cc4-402f-b7be-5d799065663a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:02.427914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d97d0-8cc4-402f-b7be-5d799065663a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:02.432532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:02.433170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:02.433449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:02.433728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:02.443032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:02.444494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0afa8-7770-4daf-8078-b6eb1472be15 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:02.456856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 757/1497] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:43:19.622762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa78a-3bf6-43ff-830c-e55c1f258468 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:19.623302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa78a-3bf6-43ff-830c-e55c1f258468 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:19.623302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfa78a-3bf6-43ff-830c-e55c1f258468 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:19.625060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 741/1498] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:19.631242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43b26-29ab-42a6-9fe0-33548df59514 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:19.631697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43b26-29ab-42a6-9fe0-33548df59514 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:19.631807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43b26-29ab-42a6-9fe0-33548df59514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:19.651587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c9e43b26-29ab-42a6-9fe0-33548df59514 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:19.652813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c9e43b26-29ab-42a6-9fe0-33548df59514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:19.662070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 758/1499] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:19.713964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12305d-b6f3-4ecc-803d-87c6ad1571fe None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:19.714264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12305d-b6f3-4ecc-803d-87c6ad1571fe None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:19.714542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12305d-b6f3-4ecc-803d-87c6ad1571fe None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:19.716468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 742/1500] 10.222.0.36 () {54 vars in 962 bytes} [Thu Nov 25 04:43:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:19.723751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6fac5-6a8a-4d3e-9253-2f2e970f92c0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:19.724039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6fac5-6a8a-4d3e-9253-2f2e970f92c0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:19.724350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6fac5-6a8a-4d3e-9253-2f2e970f92c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:19.744655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-88b6fac5-6a8a-4d3e-9253-2f2e970f92c0 None None] MFA Rules not processed for user `c7db691378f74f4f8792b779ca0181f1`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:19.745827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-88b6fac5-6a8a-4d3e-9253-2f2e970f92c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:19.752770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 759/1501] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Nov 25 04:43:19 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:43:19.760799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12305d-b6f3-4ecc-803d-87c6ad1571fe None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:19.774131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12305d-b6f3-4ecc-803d-87c6ad1571fe None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:19.778581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:19.779251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:19.779520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:19.779795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:19.789714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:19.791134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d3d22-a176-4c3f-8c04-3b7c476824b3 service glance] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:19.801106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 743/1502] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:43:22.306240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e06c6c-d15f-47ec-b1d0-8adb6fe9743b None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:22.306836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e06c6c-d15f-47ec-b1d0-8adb6fe9743b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:22.306836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e06c6c-d15f-47ec-b1d0-8adb6fe9743b None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:22.308639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 760/1503] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:22.315679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9c4b-608f-4fab-9326-99656273f104 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:22.316457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9c4b-608f-4fab-9326-99656273f104 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:22.316616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd9c4b-608f-4fab-9326-99656273f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:22.343078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d9bd9c4b-608f-4fab-9326-99656273f104 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:22.344364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d9bd9c4b-608f-4fab-9326-99656273f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:22.353363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 744/1504] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:22.377856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e06c6c-d15f-47ec-b1d0-8adb6fe9743b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:22.393095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e06c6c-d15f-47ec-b1d0-8adb6fe9743b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:22.400085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:22.400784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:22.401070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:22.401341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:22.402075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:22.403942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb44b8-6a78-44ee-b4a2-831bf3d9a50c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:22.418038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 761/1505] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Nov 25 04:43:22 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:43:24.818126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb345149-3a7f-4e97-a0dd-2a107ea5a02c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:24.819068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb345149-3a7f-4e97-a0dd-2a107ea5a02c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:24.819068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb345149-3a7f-4e97-a0dd-2a107ea5a02c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:24.822176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 745/1506] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:24.831887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314805-31c6-4fe0-898d-dbb7df6f8bd7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:24.832571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314805-31c6-4fe0-898d-dbb7df6f8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:24.832864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314805-31c6-4fe0-898d-dbb7df6f8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:24.852804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8c314805-31c6-4fe0-898d-dbb7df6f8bd7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:24.853994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8c314805-31c6-4fe0-898d-dbb7df6f8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:24.863276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 762/1507] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:24.911340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb345149-3a7f-4e97-a0dd-2a107ea5a02c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:24.928767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb345149-3a7f-4e97-a0dd-2a107ea5a02c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:24.934865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:24.935500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:24.935785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:24.936064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:24.944440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:24.947037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36270-56c4-4743-9a6b-8e596a5ae01e service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:24.962196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 746/1508] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:43:27.518416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38adf1-f421-4046-9193-b2f1de05148c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:27.519357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38adf1-f421-4046-9193-b2f1de05148c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:27.519357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38adf1-f421-4046-9193-b2f1de05148c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:27.522327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 763/1509] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:27.528390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557610f2-77f1-4bbd-add9-e48e00eecca1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:27.528825 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557610f2-77f1-4bbd-add9-e48e00eecca1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:27.528919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557610f2-77f1-4bbd-add9-e48e00eecca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:27.553803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-557610f2-77f1-4bbd-add9-e48e00eecca1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:27.555538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-557610f2-77f1-4bbd-add9-e48e00eecca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:27.563975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 747/1510] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:27.607768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38adf1-f421-4046-9193-b2f1de05148c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:27.624288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38adf1-f421-4046-9193-b2f1de05148c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:27.629441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:27.630033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:27.630359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:27.630626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:27.641651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:27.643174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc00b4a-908e-4004-9bcf-e5d36ce86a86 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:27.653178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 764/1511] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:43:30.072952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7785-e023-491e-822f-5f613b29fcf5 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:30.073574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7785-e023-491e-822f-5f613b29fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:30.073574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7785-e023-491e-822f-5f613b29fcf5 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:30.075350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 748/1512] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:30.082377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149510c-c4ee-41ab-bf84-5ce0678a9200 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:30.083134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149510c-c4ee-41ab-bf84-5ce0678a9200 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:30.083268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149510c-c4ee-41ab-bf84-5ce0678a9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:30.104926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b149510c-c4ee-41ab-bf84-5ce0678a9200 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:30.106145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b149510c-c4ee-41ab-bf84-5ce0678a9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:30.116536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 765/1513] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:30.156929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7785-e023-491e-822f-5f613b29fcf5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:30.169081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7785-e023-491e-822f-5f613b29fcf5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:30.172900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:30.173556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:30.173837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:30.174118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:30.183299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:30.184773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f9c04-8e7e-42e3-833f-9b9c940062c9 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:30.194004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 749/1514] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:43:32.648647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9679-7da8-41c7-a5ae-96a753b73a8f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:32.649286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9679-7da8-41c7-a5ae-96a753b73a8f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:32.649286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e9679-7da8-41c7-a5ae-96a753b73a8f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:32.651018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 766/1515] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:32.657083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef245-91f2-41cc-8320-e356be30747b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:32.657522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef245-91f2-41cc-8320-e356be30747b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:32.657631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef245-91f2-41cc-8320-e356be30747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:32.675978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-788ef245-91f2-41cc-8320-e356be30747b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:32.677175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-788ef245-91f2-41cc-8320-e356be30747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:32.685791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 750/1516] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:32.727785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9679-7da8-41c7-a5ae-96a753b73a8f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:32.740087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e9679-7da8-41c7-a5ae-96a753b73a8f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:32.744421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:32.745067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:32.745358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:32.745630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:32.755864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:32.757361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c6544-1045-4f2e-bc7a-6d54794d09e4 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:32.766886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 767/1517] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:43:35.361399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f94-62f9-4706-84da-ac81af3ad471 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:35.362284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f94-62f9-4706-84da-ac81af3ad471 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:35.362284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e8f94-62f9-4706-84da-ac81af3ad471 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:35.365598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 751/1518] 10.222.0.36 () {54 vars in 926 bytes} [Thu Nov 25 04:43:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:43:35.371689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013caa0-cdb4-450a-8119-06b2e770c9f3 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:35.372186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013caa0-cdb4-450a-8119-06b2e770c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:35.372283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013caa0-cdb4-450a-8119-06b2e770c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:35.392315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4013caa0-cdb4-450a-8119-06b2e770c9f3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:43:35.393520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4013caa0-cdb4-450a-8119-06b2e770c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:43:35.402888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 768/1519] 10.222.0.36 () {58 vars in 1023 bytes} [Thu Nov 25 04:43:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:43:35.444910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e8f94-62f9-4706-84da-ac81af3ad471 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:43:35.458377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e8f94-62f9-4706-84da-ac81af3ad471 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:43:35.463425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:43:35.464062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:43:35.464379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:43:35.464651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:43:35.474883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:43:35.476384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962d81-706a-4db0-8b77-2600517026f1 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:43:35.485839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 752/1520] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:43:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:44:48.014930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.015559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.015559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.038537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:44:48.039751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:48.048433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 769/1521] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:44:48.057705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.058526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.058754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.083854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:44:48.085331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:48.099186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 753/1522] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:44:48.106348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.122396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c06d0-744d-4c2e-bfac-eba06a1052ef None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.131049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.132000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.132414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.132761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.133854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:44:48.134250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.136510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.148812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 770/1523] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:44:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:44:48.157150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.166260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72c4c4-ec52-4b63-b09b-8fae0ff3cb1a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.171426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.172097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.172408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.172678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.173436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.175340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.214042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 754/1524] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:44:48 2021] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:44:48.218253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.229067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955412e-863a-48e7-9a74-fa8db12a79cd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.284271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.284867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.285153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.285422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.286162 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.288097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.318051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 771/1525] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:44:48 2021] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:44:48.322553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.333009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cc755-ee2a-415d-ac08-1c565c2e96f7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.337686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.338354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.338634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.339035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.339944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.341895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.354770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 755/1526] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:44:48.359681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.373954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d8ed-ee3c-4846-8185-e2db1fca6929 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.379304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.379988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.380311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.380596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.381332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.382935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128a88c-b3e2-43bf-b2a7-1028f2dd9416 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.396550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 772/1527] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:44:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:44:48.400812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.410818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d3446-f575-426f-82d3-60895c78424f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.415527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.416439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.416731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.417108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] PATH_INFO: `/v3/projects/1f8b492b605743b6a5f5e4b427a782c6/users/0727e7ab58734fd29c0c909fbb30c7bb/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.431729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b492b605743b6a5f5e4b427a782c6, user_id=0727e7ab58734fd29c0c909fbb30c7bb, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.436821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.452062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 756/1528] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:44:48 2021] PUT /identity/v3/projects/1f8b492b605743b6a5f5e4b427a782c6/users/0727e7ab58734fd29c0c909fbb30c7bb/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:44:48.464851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad936b-98c0-46d2-b236-28d82152fcf7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.465150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad936b-98c0-46d2-b236-28d82152fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.465424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad936b-98c0-46d2-b236-28d82152fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.494063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fdad936b-98c0-46d2-b236-28d82152fcf7 None None] MFA Rules not processed for user `0727e7ab58734fd29c0c909fbb30c7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:44:48.495366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fdad936b-98c0-46d2-b236-28d82152fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:48.560018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 773/1529] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:44:48 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:44:48.572000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.647869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654eb3-018f-4692-8c34-0a2fa2ef8821 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.654580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.655221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.655504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.655776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.663596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.665237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.674105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 757/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:44:48 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:44:48.771154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361271e0-94f2-4202-a822-e56cd005af2d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.771422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361271e0-94f2-4202-a822-e56cd005af2d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.771689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361271e0-94f2-4202-a822-e56cd005af2d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.773427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 774/1531] 10.222.0.36 () {52 vars in 829 bytes} [Thu Nov 25 04:44:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:44:48.778209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:48.850003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc742-51f4-49e7-975a-65bf60d092c4 service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:48.854946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:48.856182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:48.856488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:48.856763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] PATH_INFO: `/v3/users/0727e7ab58734fd29c0c909fbb30c7bb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:48.858028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0727e7ab58734fd29c0c909fbb30c7bb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:48.859059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:44:48.859059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:44:48.859059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:44:48.860305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:48.943942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0727e7ab58734fd29c0c909fbb30c7bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:48.944996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0727e7ab58734fd29c0c909fbb30c7bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:48.971428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0727e7ab58734fd29c0c909fbb30c7bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:48.988630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0727e7ab58734fd29c0c909fbb30c7bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.001923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0727e7ab58734fd29c0c909fbb30c7bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.011726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 758/1532] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:44:48 2021] DELETE /identity/v3/users/0727e7ab58734fd29c0c909fbb30c7bb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:44:49.020038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:49.020615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:49.020615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:49.047252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:44:49.048916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:49.134258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 775/1533] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:44:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:44:49.148587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:49.150788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:49.225368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1c3f-d162-4ad5-8894-6fb9dcb17f99 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:49.229987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:49.231041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:49.231503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:49.231787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:49.246768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:49.248750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12cbaf-627d-469a-bd41-6769d92713a8 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:49.265710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 759/1534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:44:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:44:49.653275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:44:49.655298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:44:49.667937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29947b-3235-4c1f-a6b0-f9d6ce0473cd None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:44:49.674294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:44:49.675116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:44:49.675385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:44:49.675679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] PATH_INFO: `/v3/projects/1f8b492b605743b6a5f5e4b427a782c6` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:44:49.677071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8b492b605743b6a5f5e4b427a782c6)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:44:49.678100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:44:49.678100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:44:49.678100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:44:49.679319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:44:49.744537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8b492b605743b6a5f5e4b427a782c6', 'request_id': 'req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.758063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8b492b605743b6a5f5e4b427a782c6', 'request_id': 'req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.764684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8b492b605743b6a5f5e4b427a782c6', 'request_id': 'req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.781186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] The token cache is being invalidate because project 1f8b492b605743b6a5f5e4b427a782c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:44:49.781469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.782079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9be103bb-f7a5-43d5-994c-5b2b1d5f8324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:44:49.783835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 776/1535] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:44:49 2021] DELETE /identity/v3/projects/1f8b492b605743b6a5f5e4b427a782c6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:46:15.451530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7b5f-de11-4b68-a367-56dbf3436e2c None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:15.452222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7b5f-de11-4b68-a367-56dbf3436e2c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:15.452222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7b5f-de11-4b68-a367-56dbf3436e2c None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:15.454636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 760/1536] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:46:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:15.461557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:15.462049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:15.462168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:15.471431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354caf-c2f4-4eeb-80d7-db4ff84ec183 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:15.471718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354caf-c2f4-4eeb-80d7-db4ff84ec183 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:15.472000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354caf-c2f4-4eeb-80d7-db4ff84ec183 None None] PATH_INFO: `/v3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:15.473738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 761/1537] 10.222.0.41 () {54 vars in 925 bytes} [Thu Nov 25 04:46:15 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:46:15.481826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1d8a-4a8f-4c17-af94-75d005bf3fd3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:15.482122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1d8a-4a8f-4c17-af94-75d005bf3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:15.482535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1d8a-4a8f-4c17-af94-75d005bf3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:15.483317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:15.484729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:15.502728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-868f1d8a-4a8f-4c17-af94-75d005bf3fd3 None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:15.503928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-868f1d8a-4a8f-4c17-af94-75d005bf3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:15.545688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:46:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:15.567471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 762/1539] 10.222.0.41 () {58 vars in 1015 bytes} [Thu Nov 25 04:46:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:15.704754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:15.706915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:15.788774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3211a46-358a-4248-bd20-95c73de6d31d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:15.794780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:15.795431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:15.795709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:15.795974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:15.804379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:15.805948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d727c-2e4d-4971-9fa5-94c777ea8761 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:15.815138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 778/1540] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:17.324211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5534-1ef3-4bbd-8972-e4f7086623f6 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:17.325129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5534-1ef3-4bbd-8972-e4f7086623f6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:17.325129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5534-1ef3-4bbd-8972-e4f7086623f6 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:17.328142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 763/1541] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:46:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:17.333751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfba7-943d-40cb-8f44-e45f6a662095 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:17.334190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfba7-943d-40cb-8f44-e45f6a662095 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:17.334295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecfba7-943d-40cb-8f44-e45f6a662095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:17.354795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-08ecfba7-943d-40cb-8f44-e45f6a662095 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:17.355979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-08ecfba7-943d-40cb-8f44-e45f6a662095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:17.368673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 779/1542] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:46:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:17.531864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5534-1ef3-4bbd-8972-e4f7086623f6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:17.549009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5534-1ef3-4bbd-8972-e4f7086623f6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:17.556426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:17.557060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:17.557341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:17.557610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:17.566394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:17.567993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5db1-2495-49b5-b968-dde7a8445ef3 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:17.581693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 764/1543] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:24.041671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470caa-ae21-4885-8a8c-a0dd3a73b96d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:24.042115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470caa-ae21-4885-8a8c-a0dd3a73b96d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:24.042218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470caa-ae21-4885-8a8c-a0dd3a73b96d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:24.044017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 780/1544] 10.222.0.36 () {54 vars in 960 bytes} [Thu Nov 25 04:46:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:24.049866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26315-abcd-4f12-a901-29908a9100fa None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:24.050318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26315-abcd-4f12-a901-29908a9100fa None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:24.050434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26315-abcd-4f12-a901-29908a9100fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:24.069972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-80c26315-abcd-4f12-a901-29908a9100fa None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:24.071222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-80c26315-abcd-4f12-a901-29908a9100fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:24.081192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 765/1545] 10.222.0.36 () {58 vars in 1057 bytes} [Thu Nov 25 04:46:24 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:24.089378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9470caa-ae21-4885-8a8c-a0dd3a73b96d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:24.104282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9470caa-ae21-4885-8a8c-a0dd3a73b96d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:24.109860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:24.110772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:24.111084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:24.111354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:24.120258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:24.121838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e8884-366e-49d9-a9f9-270de43eb2c9 service placement] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:24.131354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 781/1546] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:29.514722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a8e-bcb8-4682-a66f-37d14e43a711 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:29.515465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a8e-bcb8-4682-a66f-37d14e43a711 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:29.515561 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a8e-bcb8-4682-a66f-37d14e43a711 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:29.518711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 766/1547] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:46:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:29.524120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13bc1-45d8-4995-8071-af231fe69907 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:29.524594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13bc1-45d8-4995-8071-af231fe69907 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:29.524697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa13bc1-45d8-4995-8071-af231fe69907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:29.544484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-dfa13bc1-45d8-4995-8071-af231fe69907 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:29.545673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-dfa13bc1-45d8-4995-8071-af231fe69907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:29.554285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 782/1548] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:46:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:29.708861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933a8e-bcb8-4682-a66f-37d14e43a711 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:29.725988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933a8e-bcb8-4682-a66f-37d14e43a711 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:29.732587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:29.733253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:29.733510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:29.733812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:29.742859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:29.744517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be89943-f094-4a8b-bef3-1b247cd1a55d service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:29.753885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 767/1549] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:31.235758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711acef5-7308-404b-afc4-24f934f9945c None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:31.236305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711acef5-7308-404b-afc4-24f934f9945c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:31.236305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711acef5-7308-404b-afc4-24f934f9945c None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:31.238251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 783/1550] 127.0.0.1 () {54 vars in 901 bytes} [Thu Nov 25 04:46:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:31.244941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb527-d8af-4791-a746-8735a46bc39f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:31.245694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb527-d8af-4791-a746-8735a46bc39f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:31.245828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb527-d8af-4791-a746-8735a46bc39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:31.268861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ff7eb527-d8af-4791-a746-8735a46bc39f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:31.270330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ff7eb527-d8af-4791-a746-8735a46bc39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:31.279446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 768/1551] 127.0.0.1 () {58 vars in 998 bytes} [Thu Nov 25 04:46:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:31.441329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711acef5-7308-404b-afc4-24f934f9945c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:31.463802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711acef5-7308-404b-afc4-24f934f9945c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:31.470517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:31.471166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:31.471422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:31.471698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:31.481142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:31.482716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31abe7d-d335-4583-8813-2b76b78aab9e service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:31.493224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 784/1552] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:35.751045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:35.751577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:35.751577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:35.754319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 769/1553] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:46:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:35.763427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782bc-be14-4715-ba8d-632b2ca57909 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:35.763914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782bc-be14-4715-ba8d-632b2ca57909 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:35.764007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782bc-be14-4715-ba8d-632b2ca57909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:35.783985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-573782bc-be14-4715-ba8d-632b2ca57909 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:35.785269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-573782bc-be14-4715-ba8d-632b2ca57909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:35.793742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 785/1554] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:46:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:35.834463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:35.836820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:35.898639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a33c4b-95eb-4d7f-8a3f-d577b02710c4 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:35.903273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:35.903941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:35.904262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:35.904539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:35.914517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:35.915975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f01e7-0c61-4be2-b6ef-9369b5ce95fe service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:35.926216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 770/1555] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:38.300740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92418-30b3-4432-9f45-ad98107dac4f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:38.301401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92418-30b3-4432-9f45-ad98107dac4f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:38.301401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92418-30b3-4432-9f45-ad98107dac4f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:38.303359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 786/1556] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:46:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:38.310192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93956-f212-402a-909f-af12a5dc062b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:38.310635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93956-f212-402a-909f-af12a5dc062b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:38.310766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93956-f212-402a-909f-af12a5dc062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:38.337700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f3c93956-f212-402a-909f-af12a5dc062b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:38.338919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f3c93956-f212-402a-909f-af12a5dc062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:38.347983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 771/1557] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:46:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:38.386161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92418-30b3-4432-9f45-ad98107dac4f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:38.401489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92418-30b3-4432-9f45-ad98107dac4f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:38.406016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:38.406667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:38.406951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:38.407226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:38.417473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:38.418915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442a307-a0da-4850-8376-f0c8741f4d72 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:38.428836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 787/1558] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:42.489463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:42.490087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:42.490087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:42.491855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 772/1559] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:42.501933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95902b9-c090-40b2-8908-fbdb7d0062a4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:42.502415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95902b9-c090-40b2-8908-fbdb7d0062a4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:42.502525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95902b9-c090-40b2-8908-fbdb7d0062a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:42.526459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a95902b9-c090-40b2-8908-fbdb7d0062a4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:42.528300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a95902b9-c090-40b2-8908-fbdb7d0062a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:42.539464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 788/1560] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:46:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:42.593293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:42.595172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:42.657587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad91303-362f-4ac9-97f8-5d9ea0de56c7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:42.664682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:42.665705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:42.666058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:42.666330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:42.679601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:42.681106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7485e8f-85ef-4d90-8a7f-676452cd8aa1 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:42.691287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 773/1561] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:46:45.029712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402195-7bb8-47a4-9c6c-a6cb1b02fff4 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:45.030552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402195-7bb8-47a4-9c6c-a6cb1b02fff4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:45.030552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402195-7bb8-47a4-9c6c-a6cb1b02fff4 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:45.033450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 789/1562] 127.0.0.1 () {54 vars in 916 bytes} [Thu Nov 25 04:46:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:45.040929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd354a-5294-446c-a665-846c961fc487 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:45.041374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd354a-5294-446c-a665-846c961fc487 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:45.041553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd354a-5294-446c-a665-846c961fc487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:45.065484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5fdd354a-5294-446c-a665-846c961fc487 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:45.066677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5fdd354a-5294-446c-a665-846c961fc487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:45.075964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 774/1563] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Nov 25 04:46:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:45.134890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c06d-3064-4ee0-9f50-5b1947c56029 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:45.135187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c06d-3064-4ee0-9f50-5b1947c56029 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:45.135448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929c06d-3064-4ee0-9f50-5b1947c56029 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:45.137277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 790/1564] 10.222.0.36 () {54 vars in 963 bytes} [Thu Nov 25 04:46:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:46:45.144053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769281-b633-4f34-a17e-9d5bb5fa4cd2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:45.144589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769281-b633-4f34-a17e-9d5bb5fa4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:45.145065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b769281-b633-4f34-a17e-9d5bb5fa4cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:45.177132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6b769281-b633-4f34-a17e-9d5bb5fa4cd2 None None] MFA Rules not processed for user `140bf1d478d74252a94ab359064731dd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:46:45.178313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6b769281-b633-4f34-a17e-9d5bb5fa4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:46:45.186265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 775/1565] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Nov 25 04:46:45 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:46:45.194780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929c06d-3064-4ee0-9f50-5b1947c56029 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:46:45.207592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929c06d-3064-4ee0-9f50-5b1947c56029 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:46:45.211904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:46:45.212616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:46:45.212911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:46:45.213177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:46:45.223434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:46:45.224912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290dcb79-5421-4989-a8aa-bb889e3ad037 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:46:45.234439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 791/1566] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:46:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:05.653286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:05.657624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:05.657624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:05.681296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:05.682550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:05.691285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 776/1567] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:05.700676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:05.701271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:05.701271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:05.737307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:05.738762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:05.752172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 792/1568] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:05.756710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:05.769467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950561-525d-4456-8126-e53d73f8e41a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:05.778766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:05.779452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:05.779734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:05.780009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:05.780808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:05.781114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:05.782793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:05.801590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 777/1569] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:05.810447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:05.837023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314924cd-54d7-451a-82f4-6499ee31a9c4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:05.842815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:05.843505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:05.843787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:05.844061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:05.845097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:05.847415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1add3e6-2fc9-4610-8ee3-8bfa368203db admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:05.895291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 793/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:05 2021] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:05.899837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:05.918120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188614b-fb2b-4a2a-a35a-9c4478a52413 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:05.925210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2154e-5d14-4492-b206-1cd9a4705050 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:05.925501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2154e-5d14-4492-b206-1cd9a4705050 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:05.925781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2154e-5d14-4492-b206-1cd9a4705050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:05.969668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0df2154e-5d14-4492-b206-1cd9a4705050 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:05.971303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0df2154e-5d14-4492-b206-1cd9a4705050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.053297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.057091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.057091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.057091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.057091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.057091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.100164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 794/1571] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.102076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850173-7bf0-439f-a101-3abb60a5d5c8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.102590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850173-7bf0-439f-a101-3abb60a5d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.103096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850173-7bf0-439f-a101-3abb60a5d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.107286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 778/1572] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:05 2021] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.111626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.130739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9719-6776-46cb-b071-34872f38bbf8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.137274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-38850173-7bf0-439f-a101-3abb60a5d5c8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.138896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-38850173-7bf0-439f-a101-3abb60a5d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.141271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.141961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.142239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.142519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.148180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.148180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a3ac3-69e0-4bd3-9db0-f0a72855983a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.161613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 795/1573] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.162856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.163596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.163596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.173066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 779/1574] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:06.174496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f4c4-4ee5-4ead-9ef8-95a3bf63bbb0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.174783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f4c4-4ee5-4ead-9ef8-95a3bf63bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.175060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969f4c4-4ee5-4ead-9ef8-95a3bf63bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.204479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.205680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.214294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3969f4c4-4ee5-4ead-9ef8-95a3bf63bbb0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.215509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3969f4c4-4ee5-4ead-9ef8-95a3bf63bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.223064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 796/1575] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.225386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.234738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 780/1576] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.237105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.237391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.237665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.244479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f2f30-0fbf-4f5c-abdc-ae9d4cfdce87 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.254863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.257947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.257947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.257947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.259856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.261568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592147-62f7-47ab-bc40-164d9989e474 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.269490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.270697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.285245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 797/1577] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:06.287046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158adc0-6a89-40e0-8e36-5ed4e4524f7e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.287339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158adc0-6a89-40e0-8e36-5ed4e4524f7e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.287617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158adc0-6a89-40e0-8e36-5ed4e4524f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.291231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 781/1578] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.291940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.301676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80e48-958b-4693-89de-cfdada282eda None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.314548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.314791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f158adc0-6a89-40e0-8e36-5ed4e4524f7e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.315533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.315755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.316036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.316193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f158adc0-6a89-40e0-8e36-5ed4e4524f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.316846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:06.317149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.318878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.325138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 798/1579] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.326578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c4c3-afeb-44d6-b58a-a1baf8119668 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.326874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c4c3-afeb-44d6-b58a-a1baf8119668 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.327153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c4c3-afeb-44d6-b58a-a1baf8119668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.338525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 782/1580] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:06.339750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.351846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd702632-7b81-4bb6-809d-8260decdbbd5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.352071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f780c4c3-afeb-44d6-b58a-a1baf8119668 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.353488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f780c4c3-afeb-44d6-b58a-a1baf8119668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.358075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.359366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.359653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.359937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] PATH_INFO: `/v3/projects/17bb1a8800d74be6a65d51f4a5209910/users/16116ac609884621afbc308f4fe9da8d/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.368625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 799/1581] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.373979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cb31-a878-400b-af9a-7de6f51b9e55 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.374461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cb31-a878-400b-af9a-7de6f51b9e55 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.374812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cb31-a878-400b-af9a-7de6f51b9e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.377630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17bb1a8800d74be6a65d51f4a5209910, user_id=16116ac609884621afbc308f4fe9da8d, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.380336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.396419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 783/1582] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:06 2021] PUT /identity/v3/projects/17bb1a8800d74be6a65d51f4a5209910/users/16116ac609884621afbc308f4fe9da8d/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:06.402867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.403836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5a85cb31-a878-400b-af9a-7de6f51b9e55 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.405073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5a85cb31-a878-400b-af9a-7de6f51b9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.461405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e045b-c92f-4ec7-bf59-be87d9873e00 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.466240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.473199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 800/1583] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.473334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.473334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.473334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.473742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.473742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.473742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.473986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:06.473986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.473986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.482080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 784/1584] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:06.483015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.487142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.488369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.492772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d7eb8-bbfa-4b5c-a5c6-a6c4ef5162b7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.496823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 801/1585] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.497379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.497552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.498123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.498402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.498678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.499373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.501372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559887fc-3770-4d14-b58a-a1def907cdee admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.509383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5afae-40a4-4ab4-a9f4-6f55ef3a13e2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.514251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.514904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.515214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.515635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.516470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:06.516798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.518535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336acae-b83b-47c9-be72-25eeed4af7cb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.528003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 785/1586] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.529418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9e01-8ddc-4b1f-9fe5-187824858bc9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.529703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9e01-8ddc-4b1f-9fe5-187824858bc9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.529974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9e01-8ddc-4b1f-9fe5-187824858bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.538532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 802/1587] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:06.538532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfde18-7468-401a-973e-b123c8041abc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.538532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfde18-7468-401a-973e-b123c8041abc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.538532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfde18-7468-401a-973e-b123c8041abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.547877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8a3d9e01-8ddc-4b1f-9fe5-187824858bc9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.549197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8a3d9e01-8ddc-4b1f-9fe5-187824858bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.550909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0acfde18-7468-401a-973e-b123c8041abc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.552143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0acfde18-7468-401a-973e-b123c8041abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.608933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 786/1588] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.610358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.610651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.610930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.614845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 803/1589] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.616020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676baa-813e-4772-ac99-709508167560 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.616922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676baa-813e-4772-ac99-709508167560 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.617032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a676baa-813e-4772-ac99-709508167560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.636623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-1a676baa-813e-4772-ac99-709508167560 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.637355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] MFA Rules not processed for user `16116ac609884621afbc308f4fe9da8d`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.637856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1a676baa-813e-4772-ac99-709508167560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.638524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.645763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 804/1590] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.646522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676baa-813e-4772-ac99-709508167560 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.656184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a676baa-813e-4772-ac99-709508167560 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.660664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.661299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.661576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.661846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.662540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.664442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.690780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 805/1591] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.691592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.704778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 787/1592] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.706098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.717747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963464a-a145-4558-a8c8-c439f6639797 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.751203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f83a-45e6-4611-85e7-d37de31a162b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.755967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.756661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.756946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.757220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.757959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:06.758284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.759923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.771361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.771825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 806/1593] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:06.772099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.772469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.772583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.772749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.773448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.775437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f1807-0a7b-4774-8e4b-30e7361f53df admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.788141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652b225-ac2f-4330-ac93-31e0c24591b6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.793023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.793718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.794039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.794315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.795038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.796992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072a4c5-c227-48b5-b998-9520b41dfdb2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.799194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 788/1594] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.803806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.804094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.804424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.824028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.824304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 807/1595] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.825300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.825794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.826197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.826445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.843455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:06.844661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:06.885086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 789/1596] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.886010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.895056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f73e-6220-4c03-81c7-130f852fe420 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.899631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.900384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.900675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.900947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.901716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:06.902020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.902500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 808/1597] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:06.903310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.903777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.912472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff62a2a-bd69-448d-b3d0-77e5e6a60403 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.922382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 790/1598] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:06.922382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.924014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.924722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.925004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.925275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.925982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.927899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.950686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 809/1599] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:06.951476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:06.962875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0841c25-05d3-4597-941a-60961e23bc4b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.968093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.968773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.969077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.969335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:06.970040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:06.971972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:06.974341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc95f-5a97-47ea-b937-bb707e78a278 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:06.978045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:06.978770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:06.979053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:06.979359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.000590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 810/1600] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:06 2021] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.001486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.035250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.036802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.046158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 791/1601] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:06 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:07.046967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.057235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c38114-9926-40c0-9ca9-ec2fd36a30fa service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.062046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.062715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.062999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.063274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.063978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.064498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2ea02-5410-4ed7-b144-09f3a3a0e996 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.066022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.069255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.069895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.070183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.070456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.071212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.073083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.084709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 811/1602] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.088785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 792/1603] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.088926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.089948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.098685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d21cb-0694-4597-aaee-61462268576e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.099188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33b4a8-0c4e-46c5-84e8-7995f472ee3f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.103396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.104071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.104254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.104503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.104884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.105053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.105289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.105567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.105899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:07.106218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.106329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:07.106614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.107804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.108203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.128079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 812/1605] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:07.128304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 793/1605] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:07.128304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.128514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.138319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e544685-ce6e-4c53-b29c-2f4aebe511af admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.138505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e7592-602c-4e5e-8bfd-ebda83dd1b66 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.143139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.143880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.144272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.144620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.145434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.145553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.146370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.146741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.147071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.147378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.147916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.149937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.157974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 794/1606] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.158641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.171124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80a73-c333-4e2c-b1be-0d8f5b2840e4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.176515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.177188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.177482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.177760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.178470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.180460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.186309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 813/1607] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.186309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.204449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 795/1608] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.205567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.215701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469f2f4-e6b0-47a9-87bd-855fab429b7e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.252462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7176-72ae-4ed8-8512-73f9bde814d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.257027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.257690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.257969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.258251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.258983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.260729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.271043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 814/1609] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.272300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.278641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.279285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.279565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.279836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.280727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.282371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.283798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274840-fc52-4435-9bd1-a89bb06c2478 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.288752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.289521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.289915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.290309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.291305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.293166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 796/1610] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.293877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.297299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.303989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433def2f-ee96-4b83-af36-66de8944defc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.310740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.311003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.311255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.311535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.312480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.314440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.327230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 815/1611] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.329097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.343957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 797/1612] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.344932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.391843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322391b-5f73-4898-9996-ec239433b9a7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.406407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91cb8e-59c0-490b-9105-151692d99e98 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.411319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.411993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.412305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.412583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.413298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.415356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.442197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 798/1613] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.442197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.447557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.448336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.448601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.448927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.449637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.451124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae006b9-7491-49ac-8837-00526746676e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.451246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.456402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.457065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.457369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.457630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.458377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.460002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.461412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 816/1614] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.465840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.470768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 799/1615] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.471482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.478492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b880c-982b-4233-890d-d7d162c308f2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.482410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcd7a3-c14b-4f20-a230-c21d3371562b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.483659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.484623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.484911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.485178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] PATH_INFO: `/v3/projects/b78f91fa9da147eda471e50cc9684f97/users/9afb7b5b35cb487ba063c7ee7fbcd4fd/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.487934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.488710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.489063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.489407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.490374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.492043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.502108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78f91fa9da147eda471e50cc9684f97, user_id=9afb7b5b35cb487ba063c7ee7fbcd4fd, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.504352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 800/1616] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.504352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.507586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.515833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a86a-7af0-4f55-a539-1009f8863377 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.520454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.521158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.521434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.521707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.522420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.524856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.549723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 817/1617] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:07 2021] PUT /identity/v3/projects/b78f91fa9da147eda471e50cc9684f97/users/9afb7b5b35cb487ba063c7ee7fbcd4fd/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:07.549723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.560055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 801/1618] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/users => generated 286 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.561202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.572577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612c41-2521-4550-8968-80c74ac1207b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.645677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381c6ac-c243-4193-9161-9592364def3f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.650884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.651805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.652253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.652535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.653267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.655115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.655275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.655915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.656242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.656549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.657302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.658900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.670463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 802/1619] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.671569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.682865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 818/1620] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:07.682865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.683157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86379d-4dfc-4de0-a4d2-cbc32575df3e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.686533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.687429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.687710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.687980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] PATH_INFO: `/v3/projects/f231a19b2ca6447282b854aaf157e86c/users/5010bab96b044f0d8d70c422ac1a5ade/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.693961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdc9a3-37c4-4aea-a37b-e3febd4c7cfe admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.698791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.699476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.699757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.700025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.700806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.702467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.705091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f231a19b2ca6447282b854aaf157e86c, user_id=5010bab96b044f0d8d70c422ac1a5ade, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.707772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f83b-e15c-441f-b313-47734965ed0e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.717177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 819/1621] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.718524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.723118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 803/1622] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:07 2021] PUT /identity/v3/projects/f231a19b2ca6447282b854aaf157e86c/users/5010bab96b044f0d8d70c422ac1a5ade/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:07.724445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.724445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.724666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.732691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312c8b-33d4-4d1e-974f-656311881ac5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.744922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:07.746164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:07.791099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.792376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.792667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.792938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] PATH_INFO: `/v3/projects/94580ff551b04feab72762d02a2ba7c6/users/dce4824948ae424a86343a9a9bbc3bc2/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.805776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 804/1623] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:07.806716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.807994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=94580ff551b04feab72762d02a2ba7c6, user_id=dce4824948ae424a86343a9a9bbc3bc2, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.810995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.816086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c44bd-52f8-4c2c-a8a2-c2589ae16b4d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.821221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.822041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.822620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.823252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.824270 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.826538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.827256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 820/1624] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:07 2021] PUT /identity/v3/projects/94580ff551b04feab72762d02a2ba7c6/users/dce4824948ae424a86343a9a9bbc3bc2/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:07.828065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.837962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 805/1625] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.839289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.848839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a751a4-cdbf-47e5-8878-bca058ce5055 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.889878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17c69e-03cc-412a-90a5-8f933c1710ef admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.894911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.895626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.895904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.896194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.897055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.898630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.906577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.907229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.907508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.907780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.908600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.912218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 821/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.912218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.912459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd6a087-e486-40dd-a8a8-405592a51069 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.919855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec1093-8e9e-4e3a-8b57-b022a6bc98d2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:07.920942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 806/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:07.922165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.922447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.922722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.925295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:07.926188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.926464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.926737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] PATH_INFO: `/v3/projects/8d773db29571458586043ef5fa3454c2/users/cf5c43b0d61241578cf162de6aa559d7/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.940136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:07.941756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d773db29571458586043ef5fa3454c2, user_id=cf5c43b0d61241578cf162de6aa559d7, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:07.942059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:07.944407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b3334-6184-4ebc-8227-5653f54ef687 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:07.950642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 807/1628] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:07.951559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:07.962224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 822/1629] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:07 2021] PUT /identity/v3/projects/8d773db29571458586043ef5fa3454c2/users/cf5c43b0d61241578cf162de6aa559d7/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:07.962224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:07.962224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:07.962224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:07.977549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:07.979055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.014258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7a110-2f35-47d8-a405-9454c4e7831b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.044403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 823/1630] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.045340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.054680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720a872-f300-4f12-b2ed-4684c61b4292 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.059970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.060665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.060931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.061224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.061973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.063492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.063635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.064137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.064449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.064718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.073866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 824/1631] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:08.074016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.074483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.075527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.083640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1d9dc-2437-4989-9661-b07859712523 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.085417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 808/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:08.086214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.090205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.091135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.091393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.091720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] PATH_INFO: `/v3/projects/99447c5dc47d49abb101be810b5c0f5a/users/7d9ff8cd9ee34e34a820fb78b23f4592/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.096428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f86d3-b532-424f-b036-675686288cc1 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.102142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.102839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.103146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.103477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.104254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.105879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.109628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99447c5dc47d49abb101be810b5c0f5a, user_id=7d9ff8cd9ee34e34a820fb78b23f4592, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.112755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9866f0-5e8a-47a6-9c75-7b7dc5a2d090 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.117187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 809/1633] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:08.118009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.128979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 825/1634] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:08 2021] PUT /identity/v3/projects/99447c5dc47d49abb101be810b5c0f5a/users/7d9ff8cd9ee34e34a820fb78b23f4592/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:08.130108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.130447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.130770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.140296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79560b-83d5-4c6d-8f3b-202929e3ede4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.148836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:08.150083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.200810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.201563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.201906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.202239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.223619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 826/1635] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.224773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.237779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ffb94-f20f-4d94-9c1a-d6a5a3303317 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.241662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.242432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.242720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.242993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.252995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.254502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.270812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.271936 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 827/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:08.272354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.273562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.283517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 810/1637] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:08.283901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.291861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec655-d84f-4f22-8416-c924925338d5 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.295467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dff15-19d7-49d0-827b-0605310ba1e1 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.298547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.298547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.298547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.298958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] PATH_INFO: `/v3/projects/c78a18dd20f8496681d2afe94a3aebdf/users/23aaf65c46674a098d852ebf80616b86/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.300049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.300947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.301227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.301495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] PATH_INFO: `/v3/projects/51337e5f01d5448ea9a877b53016681f/users/1fb422a1adfc46b0a241cb7e82e8d9c0/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.318487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a18dd20f8496681d2afe94a3aebdf, user_id=23aaf65c46674a098d852ebf80616b86, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.320208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51337e5f01d5448ea9a877b53016681f, user_id=1fb422a1adfc46b0a241cb7e82e8d9c0, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.321462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6f80c-8d0e-4ce3-ae8b-53f16e488880 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.323229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.337131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 828/1638] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:08 2021] PUT /identity/v3/projects/c78a18dd20f8496681d2afe94a3aebdf/users/23aaf65c46674a098d852ebf80616b86/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:08.341364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 811/1639] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:08 2021] PUT /identity/v3/projects/51337e5f01d5448ea9a877b53016681f/users/1fb422a1adfc46b0a241cb7e82e8d9c0/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:08.342222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.343889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.346052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e2e7-ceda-49bb-8711-fa71a35d6551 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.346533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e2e7-ceda-49bb-8711-fa71a35d6551 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.347013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e2e7-ceda-49bb-8711-fa71a35d6551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.378284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9486e2e7-ceda-49bb-8711-fa71a35d6551 None None] MFA Rules not processed for user `7d9ff8cd9ee34e34a820fb78b23f4592`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:08.379516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9486e2e7-ceda-49bb-8711-fa71a35d6551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.403497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e94ae-6b7c-4c9a-8a23-8a3c3ec9b4d7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.408373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.409134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.410130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.410130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.454077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 829/1640] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.455840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.456791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.456791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.478599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.481061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d383632-5373-43aa-9f5c-50a38d8d35ff service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.490934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 812/1641] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:08.492435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.492913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.493212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.498326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:08.499566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.513182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 830/1642] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.513182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.524950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] MFA Rules not processed for user `23aaf65c46674a098d852ebf80616b86`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:08.526442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.526887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74bd11-fe59-448f-b3f2-fef0c83a8783 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.533498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.534537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.534881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.535275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.536078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.538723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.583249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 831/1643] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:08.583919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.629520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 813/1644] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.629520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.635054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefe69-fb7b-4f0d-b430-e069eea0a204 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.688741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ba4a-bdc4-45a4-8868-237a01f2844b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.694884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.695624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.695916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.696215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.705176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.706115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.706497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.708268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.709111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.710344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.712535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c48db-73e5-4daa-8fba-d7fb80117422 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.715384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.727550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 832/1645] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:08.731940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97329-8e8a-41de-b687-bf703f74e151 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.732405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97329-8e8a-41de-b687-bf703f74e151 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.732694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab97329-8e8a-41de-b687-bf703f74e151 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.745519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 833/1646] 10.222.0.36 () {54 vars in 961 bytes} [Thu Nov 25 04:48:08 2021] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:08.746973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.747264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.747546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.778319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:08.779892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:08.783430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 814/1647] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:08.787439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.802322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bde2b-c254-47fc-8c19-e99a716c6a61 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.811175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.812504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.813059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.813731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.814764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.816703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.832500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 815/1648] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:08.837195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.853667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9194cc-b10e-4e70-ae8a-ee0fdf9bd25d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.867064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:08.867988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:08.868300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:08.868585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] PATH_INFO: `/v3/projects/4e76df64520c46cd9543acdd830845ae/users/b75c7c59fa0f487ea67bbfa31ab45962/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:08.886415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 834/1649] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Nov 25 04:48:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:08.887761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:08.888674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e76df64520c46cd9543acdd830845ae, user_id=b75c7c59fa0f487ea67bbfa31ab45962, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:08.891772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:08.902334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1834d-f95f-4d5e-9c19-46d122e6efd6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:08.911485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 816/1650] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:08 2021] PUT /identity/v3/projects/4e76df64520c46cd9543acdd830845ae/users/b75c7c59fa0f487ea67bbfa31ab45962/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:08.916747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.008767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.010976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.012355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.014151 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.028319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3bea-1061-4262-907e-f0e2d9f063d1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.035565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.036325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.036686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.036964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.037928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.041590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.067483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 817/1651] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:09.071864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.099750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f806ee-f978-4f4a-a940-db5aba845eb2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.118408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.119539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.121036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.121339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] PATH_INFO: `/v3/projects/4e76df64520c46cd9543acdd830845ae/users/b75c7c59fa0f487ea67bbfa31ab45962/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.127078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e76df64520c46cd9543acdd830845ae, user_id=b75c7c59fa0f487ea67bbfa31ab45962, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.129793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cb8f9-0737-4850-a7fc-cbd463d9e3e1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.162002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 818/1652] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:09 2021] PUT /identity/v3/projects/4e76df64520c46cd9543acdd830845ae/users/b75c7c59fa0f487ea67bbfa31ab45962/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:09.163726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.166827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.167113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.167392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.170968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2a56f-0a81-4d7b-bb8b-2a66d7841e89 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.183553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 835/1653] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:08 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:09.185128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfa5a8-e921-46bd-96a3-b643c55561c0 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.185416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfa5a8-e921-46bd-96a3-b643c55561c0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.185759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfa5a8-e921-46bd-96a3-b643c55561c0 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.187604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 836/1654] 10.222.0.36 () {54 vars in 961 bytes} [Thu Nov 25 04:48:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:09.194795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8b13-62b9-4a40-a6ee-ee34e4e28830 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.195088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8b13-62b9-4a40-a6ee-ee34e4e28830 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.195403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e8b13-62b9-4a40-a6ee-ee34e4e28830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.226369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a99e8b13-62b9-4a40-a6ee-ee34e4e28830 None None] MFA Rules not processed for user `b75c7c59fa0f487ea67bbfa31ab45962`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.227740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a99e8b13-62b9-4a40-a6ee-ee34e4e28830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.237216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] MFA Rules not processed for user `9afb7b5b35cb487ba063c7ee7fbcd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.238565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.331651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 837/1655] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.335080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc1a2-5cc9-438e-b59f-aebc3b6a5405 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.335080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc1a2-5cc9-438e-b59f-aebc3b6a5405 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.335080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc1a2-5cc9-438e-b59f-aebc3b6a5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.358971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c48bc1a2-5cc9-438e-b59f-aebc3b6a5405 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.360404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c48bc1a2-5cc9-438e-b59f-aebc3b6a5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.371846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 819/1656] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.383189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.507100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 838/1657] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.508865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354775-be54-4020-b4b1-2fa1fa25354f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.508865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354775-be54-4020-b4b1-2fa1fa25354f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.509084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce354775-be54-4020-b4b1-2fa1fa25354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.510553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a618d09-d802-408d-ad66-c1b9f43d7330 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.516297 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.517050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.517332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.517603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.542161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.543647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabfec7-b668-4430-b9f7-df52a7fd14eb service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.548288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ce354775-be54-4020-b4b1-2fa1fa25354f None None] MFA Rules not processed for user `9afb7b5b35cb487ba063c7ee7fbcd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.549494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ce354775-be54-4020-b4b1-2fa1fa25354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.570230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 820/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:09 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:09.571840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdeaf-da98-41a9-9b09-0ba2071bb6a3 None None] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.572583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdeaf-da98-41a9-9b09-0ba2071bb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.572880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bdeaf-da98-41a9-9b09-0ba2071bb6a3 None None] PATH_INFO: `/` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.590114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 839/1659] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.591937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dda9-3744-4756-89d0-b4390d77409f None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.592257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dda9-3744-4756-89d0-b4390d77409f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.592535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8dda9-3744-4756-89d0-b4390d77409f None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.596253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 821/1660] 10.222.0.36 () {54 vars in 912 bytes} [Thu Nov 25 04:48:09 2021] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:09.596576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 840/1661] 10.222.0.36 () {54 vars in 912 bytes} [Thu Nov 25 04:48:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:09.602136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.602416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.603050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.605684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.606285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.606396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.651503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.653581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:09.656121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.657316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:09.678435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 841/1662] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.679873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 822/1663] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:48:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:09.692692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.704905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903c53-b853-4d73-a364-cc73f96f15da None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.708763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.710826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.712049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.713519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.714064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.721619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203e69c-dd31-4c11-85e7-14cc161496f9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.725742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.726685 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.727171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.727633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.729919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.731902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.741872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.743618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2848bb-a210-4892-bde9-8c7f68dc93cf service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.749073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 842/1664] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:09.758021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 823/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:09.831896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:09.854590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283146-e777-4c89-b4f9-e57f5a23dfec service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:09.880743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:09.881426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:09.881708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:09.882156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:09.893326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:09.921401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9643e4c-5071-44f1-a081-068bfa4f017c service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:09.977017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 843/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:09 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:10.695025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa695c-fc08-4b57-b37b-2f3a194f35e4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:10.695325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa695c-fc08-4b57-b37b-2f3a194f35e4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:10.695662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa695c-fc08-4b57-b37b-2f3a194f35e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:10.748225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6aaa695c-fc08-4b57-b37b-2f3a194f35e4 None None] MFA Rules not processed for user `dce4824948ae424a86343a9a9bbc3bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:10.749564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6aaa695c-fc08-4b57-b37b-2f3a194f35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:10.858064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e79a4-bb92-4273-a1b2-5807daefbd12 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:10.858755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e79a4-bb92-4273-a1b2-5807daefbd12 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:10.858987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e79a4-bb92-4273-a1b2-5807daefbd12 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:10.861139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 844/1667] 10.222.0.36 () {54 vars in 912 bytes} [Thu Nov 25 04:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:48:10.869176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 824/1668] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:10 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:10.873753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e79a4-bb92-4273-a1b2-5807daefbd12 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:10.888246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:10.888246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:10.888246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:10.944021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:10.946595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:10.996965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e79a4-bb92-4273-a1b2-5807daefbd12 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.003246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.003970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.004411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.004854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.005851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.007966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.010123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 825/1669] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:48:10 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:11.038426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.043897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 845/1670] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:10 2021] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:11.046961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.052135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7824-bf2d-4363-88fd-4a995f63a1b6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.122658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.123735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.124112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.124529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.130560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1618c4-ad5d-42b6-844e-71309fdaa14b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.139096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.141383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.150587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.152209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.152764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.153286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.153708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 826/1671] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:11.154902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.157106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.184886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 846/1672] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:11 2021] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:11.188740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.203435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf82a9e-f188-4139-98ef-f56e4474fea1 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.209340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.210230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.210343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.210605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.211350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.213553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.224945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 827/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:11.228975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.240470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cfe95-30f2-4897-b93f-96ea74927732 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.245883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.247077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.247610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.247920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] PATH_INFO: `/v3/projects/b672d71d22864e7f92fda0ae6824fd53/users/6a7f55b988db41cb876246520ab80f5e/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.271173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b672d71d22864e7f92fda0ae6824fd53, user_id=6a7f55b988db41cb876246520ab80f5e, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.273931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.291066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 847/1674] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:11 2021] PUT /identity/v3/projects/b672d71d22864e7f92fda0ae6824fd53/users/6a7f55b988db41cb876246520ab80f5e/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:11.295967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.308470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecd2d-9067-4adb-928a-3444c47d8d32 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.377333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.378233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.378644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.378962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.379980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.381693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6891ea-769a-4d1e-ab2b-152211ff48de admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.396443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 828/1675] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:11.400368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:11.412359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a83d2-3963-48dc-b009-b0dffc6165f9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:11.417435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:11.418331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.418604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.418870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] PATH_INFO: `/v3/projects/b672d71d22864e7f92fda0ae6824fd53/users/6a7f55b988db41cb876246520ab80f5e/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:11.421001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b672d71d22864e7f92fda0ae6824fd53, user_id=6a7f55b988db41cb876246520ab80f5e, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:11.423586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c0f9-8677-4188-a5bd-e4077cf53332 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:11.434813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 848/1676] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:11 2021] PUT /identity/v3/projects/b672d71d22864e7f92fda0ae6824fd53/users/6a7f55b988db41cb876246520ab80f5e/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:11.981701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:11.982260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:11.982260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.046081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] MFA Rules not processed for user `1fb422a1adfc46b0a241cb7e82e8d9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:12.047438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:12.311956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 829/1677] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:12.327959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.330103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.331033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.371149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] MFA Rules not processed for user `1fb422a1adfc46b0a241cb7e82e8d9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:12.372565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:12.386811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 849/1678] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:12.414320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:12.489702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:12.540950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd4e6a-485c-49b7-81ec-8551ce327de4 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:12.549487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:12.550512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.550956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.551482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.569864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:12.572130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:12.596113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 830/1679] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:12 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:12.597067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:12.645645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86b53e-905c-4652-b0f4-28b552aba4d3 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:12.657315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:12.658286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.658573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.659862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] PATH_INFO: `/v3/users/7d9ff8cd9ee34e34a820fb78b23f4592` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.661724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9ff8cd9ee34e34a820fb78b23f4592)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:12.665021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: WARNING py.warnings [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:48:12.665021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: warnings.warn(msg) Nov 25 04:48:12.665021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: Nov 25 04:48:12.667893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:12.745097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e88de-52de-4088-84c5-5d0a82a33ccb service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:12.753716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:12.754744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.755120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.755459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.758721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:12.777286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:12.779763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9ff8cd9ee34e34a820fb78b23f4592'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:12.780338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfba0f-63ac-47aa-a3aa-b67d68061f33 service placement] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:12.780662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9ff8cd9ee34e34a820fb78b23f4592'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:12.795961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 831/1680] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:12.797411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.797704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.797983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.804407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9ff8cd9ee34e34a820fb78b23f4592'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:12.818120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9ff8cd9ee34e34a820fb78b23f4592'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:12.818943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e893fe91-3926-42ff-badd-27b6a626a44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9ff8cd9ee34e34a820fb78b23f4592'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:12.849834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 850/1681] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:12 2021] DELETE /identity/v3/users/7d9ff8cd9ee34e34a820fb78b23f4592 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:12.856511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:12.856729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] MFA Rules not processed for user `6a7f55b988db41cb876246520ab80f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:12.857107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:12.857452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:12.858964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:12.880810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:12.882632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:13.004719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 832/1682] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:13.055668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 851/1683] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:13.076360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:13.077875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:13.171404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d8448-4167-4734-a1f6-19f03fe8a24c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:13.177379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:13.180109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:13.180554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:13.180969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:13.203563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:13.205661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ad82-8257-4ebb-b92d-50eaaecade50 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:13.221317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 833/1684] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:13.620244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:13.622123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:13.643614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77036c2-fc82-49bf-b52d-e6dcc99c2657 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:13.661784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:13.662726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:13.663004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:13.663273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] PATH_INFO: `/v3/users/23aaf65c46674a098d852ebf80616b86` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:13.667273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23aaf65c46674a098d852ebf80616b86)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:13.668197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:13.790227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23aaf65c46674a098d852ebf80616b86'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:13.791511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23aaf65c46674a098d852ebf80616b86'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:13.834379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23aaf65c46674a098d852ebf80616b86'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:13.851405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23aaf65c46674a098d852ebf80616b86'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:13.852042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23aaf65c46674a098d852ebf80616b86'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:13.893057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 852/1685] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:13 2021] DELETE /identity/v3/users/23aaf65c46674a098d852ebf80616b86 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:13.898662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:13.898958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:13.899233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:13.929220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:13.930510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:14.047797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 834/1686] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:14.094586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:14.096845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:14.245384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74291fa-6123-486b-a6b7-6f61ac4d3984 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:14.255815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:14.256536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:14.259353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:14.260923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:14.286373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:14.288791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:14.312132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 853/1687] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:15.832193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:15.834371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:15.854306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d0dc-4a2e-4086-85af-cc026701aaee None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:15.870483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:15.871692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:15.872136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:15.872604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] PATH_INFO: `/v3/projects/99447c5dc47d49abb101be810b5c0f5a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:15.874023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99447c5dc47d49abb101be810b5c0f5a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:15.875199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: WARNING py.warnings [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 25 04:48:15.875199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: warnings.warn(msg) Nov 25 04:48:15.875199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: Nov 25 04:48:15.877243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:16.024730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99447c5dc47d49abb101be810b5c0f5a', 'request_id': 'req-ed20a258-f3dd-47d8-a081-dfa901cc27c2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.057588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99447c5dc47d49abb101be810b5c0f5a', 'request_id': 'req-ed20a258-f3dd-47d8-a081-dfa901cc27c2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.074522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99447c5dc47d49abb101be810b5c0f5a', 'request_id': 'req-ed20a258-f3dd-47d8-a081-dfa901cc27c2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.098409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] The token cache is being invalidate because project 99447c5dc47d49abb101be810b5c0f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:16.098828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.101142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ed20a258-f3dd-47d8-a081-dfa901cc27c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.102783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 835/1688] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:15 2021] DELETE /identity/v3/projects/99447c5dc47d49abb101be810b5c0f5a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:16.107147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:16.121299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752b1f-58b4-4e2e-8ccb-ab4b0ac6c5dd service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:16.206284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:16.206570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:16.206849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:16.238625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:16.242940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:16.261932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:16.263244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:16.263758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:16.265759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] PATH_INFO: `/v3/users/b75c7c59fa0f487ea67bbfa31ab45962` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:16.271676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75c7c59fa0f487ea67bbfa31ab45962)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:16.286630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:16.384124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 836/1689] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:48:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 25 04:48:16.394844 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75c7c59fa0f487ea67bbfa31ab45962'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.395700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75c7c59fa0f487ea67bbfa31ab45962'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.445680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75c7c59fa0f487ea67bbfa31ab45962'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.477999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75c7c59fa0f487ea67bbfa31ab45962'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.479019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75c7c59fa0f487ea67bbfa31ab45962'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:16.539766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 854/1690] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:16 2021] DELETE /identity/v3/users/b75c7c59fa0f487ea67bbfa31ab45962 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:16.698149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:16.699838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:16.829712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0a98-f94d-4c27-b9d8-97c3d31e66b8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:16.955666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:16.957129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:16.958414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:16.958818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:16.965241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:17.048691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:17.050137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:17.080787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:17.082715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928702a-18e7-4845-920c-4da7582b2db5 service swift] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:17.110795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 837/1691] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:48:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:48:17.179415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d966d3-5a75-4dbd-ad92-ad4a1bf9c638 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:17.187331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:17.188922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:17.189465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:17.190010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] PATH_INFO: `/v3/projects/c78a18dd20f8496681d2afe94a3aebdf` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:17.194040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a18dd20f8496681d2afe94a3aebdf)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:17.197610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:17.310525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a18dd20f8496681d2afe94a3aebdf', 'request_id': 'req-bb5a5652-750c-4692-9fec-d96262a2be77'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:17.323859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a18dd20f8496681d2afe94a3aebdf', 'request_id': 'req-bb5a5652-750c-4692-9fec-d96262a2be77'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:17.336358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a18dd20f8496681d2afe94a3aebdf', 'request_id': 'req-bb5a5652-750c-4692-9fec-d96262a2be77'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:17.371559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] The token cache is being invalidate because project c78a18dd20f8496681d2afe94a3aebdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:17.373953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:17.377262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bb5a5652-750c-4692-9fec-d96262a2be77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:17.383264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 855/1692] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:17 2021] DELETE /identity/v3/projects/c78a18dd20f8496681d2afe94a3aebdf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:17.389874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:17.390487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:17.390864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:17.422732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:17.424173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:17.587253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 838/1693] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:17.594227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:17.594822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:17.595211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:17.646531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:17.651350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:17.690095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 856/1694] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:17.694171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:17.718782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e39fc-5bf6-4e0b-820f-4e42096a710b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:17.734425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:17.738772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:17.739316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:17.739766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:17.744664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:17.746531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:17.752504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:17.805567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 839/1695] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:17.807329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:17.823029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348c78d-3432-4aa1-b8ed-99ae489aeb40 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:17.834326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:17.835341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:17.835727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:17.836141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:17.836934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:17.839152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:17.910638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 857/1696] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:17 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:17.914732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:17.926580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce04de-d23c-492b-962c-840b30d91897 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.028264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.029074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.029258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.029677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.030592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.032769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.082814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.083379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 840/1697] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:17 2021] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:18.098959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42729a-5251-47c3-9d2d-ffc0f1d2ae33 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.112529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.113866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.115091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.117006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.119556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.124652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.157146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 858/1698] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:18.160819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.176181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721c6b-22d9-4cd1-b0eb-405c765f01c0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.218751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.223519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.223816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.232314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.238617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.240381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.298239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 841/1699] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:18.299367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.311309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed98558-98a6-41aa-89eb-381d7f1d3b4f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.336609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.337979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.338837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.339411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] PATH_INFO: `/v3/projects/3876fed1eadf48b494c056a5cb9a7afd/users/dd8fcf46b7074c72b93bc0bbb366de69/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.360794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.362932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:18.378056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3876fed1eadf48b494c056a5cb9a7afd, user_id=dd8fcf46b7074c72b93bc0bbb366de69, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.387889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87caa6b-2cfc-4285-a992-d73b3ae89d01 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.391119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47cb6c-2105-45d9-aa4b-b101dd691a1d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.406736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.407745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.408031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.408339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] PATH_INFO: `/v3/projects/4e76df64520c46cd9543acdd830845ae` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.410057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e76df64520c46cd9543acdd830845ae)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.412568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.414561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 859/1700] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:18 2021] PUT /identity/v3/projects/3876fed1eadf48b494c056a5cb9a7afd/users/dd8fcf46b7074c72b93bc0bbb366de69/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:18.426524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3a0b-f4d1-4b5d-873f-845e2840cbda None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.426977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3a0b-f4d1-4b5d-873f-845e2840cbda None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.427362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3a0b-f4d1-4b5d-873f-845e2840cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.471170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0acf3a0b-f4d1-4b5d-873f-845e2840cbda None None] MFA Rules not processed for user `dd8fcf46b7074c72b93bc0bbb366de69`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:18.482955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0acf3a0b-f4d1-4b5d-873f-845e2840cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:18.586682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e76df64520c46cd9543acdd830845ae', 'request_id': 'req-c1d56d59-89df-43b5-8991-dd726d88debf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.602941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e76df64520c46cd9543acdd830845ae', 'request_id': 'req-c1d56d59-89df-43b5-8991-dd726d88debf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.620955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e76df64520c46cd9543acdd830845ae', 'request_id': 'req-c1d56d59-89df-43b5-8991-dd726d88debf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.641582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] The token cache is being invalidate because project 4e76df64520c46cd9543acdd830845ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:18.642324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.644757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.647839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 842/1701] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:18 2021] DELETE /identity/v3/projects/4e76df64520c46cd9543acdd830845ae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:18.649185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.653125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:18.699152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 860/1702] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:18.705047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.705369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.706456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.772563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:18.776647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:18.810626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56d59-89df-43b5-8991-dd726d88debf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.824190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.826013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.826013 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:18.826241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] PATH_INFO: `/v3/users/dce4824948ae424a86343a9a9bbc3bc2` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:18.829776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce4824948ae424a86343a9a9bbc3bc2)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:18.835457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:18.923206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce4824948ae424a86343a9a9bbc3bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.926356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce4824948ae424a86343a9a9bbc3bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.958710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 861/1703] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:18.958710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:18.958710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:18.959110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce4824948ae424a86343a9a9bbc3bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.973324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce4824948ae424a86343a9a9bbc3bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.984855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e319e7-2382-445b-9c8d-72c102c24d81 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:18.993129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d4220cec-869b-4b65-bad8-d190278e8ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce4824948ae424a86343a9a9bbc3bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:18.998733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:18.999435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:18.999862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.000315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.001231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.003636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.011418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 843/1704] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:18 2021] DELETE /identity/v3/users/dce4824948ae424a86343a9a9bbc3bc2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:19.013229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.013636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.013994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.055148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:19.058927 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:19.072698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 862/1705] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:18 2021] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:19.075624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.206795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 844/1706] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:19.209075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.209720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:19.235112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e41f75-8403-499b-b6c6-303aa3fac3e2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.240209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6465c-f280-478a-b713-b85f4dd63aa7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.247660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.249637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.249637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.250035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] PATH_INFO: `/v3/users/16116ac609884621afbc308f4fe9da8d` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.250799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.252348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.252607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=16116ac609884621afbc308f4fe9da8d)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.254189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.254828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.255262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.256550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.263401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.354960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16116ac609884621afbc308f4fe9da8d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:19.355869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 863/1707] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:19 2021] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:19.356446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16116ac609884621afbc308f4fe9da8d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:19.364590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.376030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:19.388011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16116ac609884621afbc308f4fe9da8d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:19.402901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16116ac609884621afbc308f4fe9da8d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:19.419551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16116ac609884621afbc308f4fe9da8d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:19.430583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 845/1708] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:19 2021] DELETE /identity/v3/users/16116ac609884621afbc308f4fe9da8d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:19.431847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.439262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba35d-11dd-4453-b9ce-22cc3b4a86b1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.440325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:19.600382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.609179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.609544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.609777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.610574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:19.610887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.612573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24017b8-bf08-45d2-853b-47c8da41bcbb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.620539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cc63c-619d-485e-9b2d-9d3ef816c1ee admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.632374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.633083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.633367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.633646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.634565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.638401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.647727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 864/1709] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:19.649927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.650443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.650929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.690506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 846/1710] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:19.691785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.695916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:19.700787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:19.716975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585e58-a4ef-4b98-9513-eb183067296a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.721158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 865/1711] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:19.722606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.738121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae63e8-ea18-447a-8b57-ff2bdc8ebb3c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:19.740907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.741786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.742074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.742377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.745865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:19.747594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:19.748083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:19.748570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] PATH_INFO: `/v3/projects/674ae8000ffd4d1f87689fb92b487e2c/users/cc427a742b05458bb9a48dcf66da2d27/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:19.751648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.753773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.771515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674ae8000ffd4d1f87689fb92b487e2c, user_id=cc427a742b05458bb9a48dcf66da2d27, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:19.776099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:19.806361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 866/1712] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:19 2021] PUT /identity/v3/projects/674ae8000ffd4d1f87689fb92b487e2c/users/cc427a742b05458bb9a48dcf66da2d27/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:19.808009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.831316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 847/1713] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:19 2021] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:19.837055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:19.930219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95232692-a779-4f85-978c-3647300d5276 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.065918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f28ea-203c-43b2-b7e8-00a2ea141d63 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.078245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.079145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.079577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.080226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.081243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.091659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.133018 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.135934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.136252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.136522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.137372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.141903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 848/1714] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:19 2021] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:20.141903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.143313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.145749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:20.166442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 867/1715] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:20.175313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.216519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d3c27-9505-4d2f-ab64-e6687ca349db admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.223237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.224240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.224676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.225084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.225981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.227736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.252927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 868/1716] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:20 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:20.256758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.276416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7a475-74d7-4a9e-a74a-65ddf6537594 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.293411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.294607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.295309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.296667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a64c-ca7d-4084-a561-74c810f17887 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.297130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] PATH_INFO: `/v3/projects/674ae8000ffd4d1f87689fb92b487e2c/users/cc427a742b05458bb9a48dcf66da2d27/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.300887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674ae8000ffd4d1f87689fb92b487e2c, user_id=cc427a742b05458bb9a48dcf66da2d27, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.305415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.309784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.310699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.311140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.311566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.333903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.337681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becea21-b608-4830-aa2d-542cd62d698b service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.356456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 869/1717] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:20 2021] PUT /identity/v3/projects/674ae8000ffd4d1f87689fb92b487e2c/users/cc427a742b05458bb9a48dcf66da2d27/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:20.358385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.385897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 849/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:20.403604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.404109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.404598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.463600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] MFA Rules not processed for user `cc427a742b05458bb9a48dcf66da2d27`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:20.464911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:20.541305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e81ee-5607-455e-9d5a-db082a7e91e0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.552495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.553281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.553579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.553870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.559012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.560845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.631783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 870/1719] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:20 2021] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:20.633600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 850/1720] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:20 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:20.635165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.638782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.670426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0caf23-257a-4a8c-896e-cb44682eb6fc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.674855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9e197-1ec4-4df7-b861-2ec5872a7a87 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:20.696880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.697960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.698362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.701383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] PATH_INFO: `/v3/projects/ed4555b6f0734b2da2f55a3b87efb863/users/71a9b049c29b464f93b8d5e2a3ac7a58/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.719351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:20.722159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.722594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.724222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] PATH_INFO: `/v3/users/dd8fcf46b7074c72b93bc0bbb366de69` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.732284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8fcf46b7074c72b93bc0bbb366de69)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.743437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.744529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4555b6f0734b2da2f55a3b87efb863, user_id=71a9b049c29b464f93b8d5e2a3ac7a58, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:20.752666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1912c-45e2-4898-805e-0f3cd304c8c1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:20.784333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 871/1721] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:20 2021] PUT /identity/v3/projects/ed4555b6f0734b2da2f55a3b87efb863/users/71a9b049c29b464f93b8d5e2a3ac7a58/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:20.795900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655926d-d1ec-4dbb-a381-81446d6c3a1d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:20.796217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655926d-d1ec-4dbb-a381-81446d6c3a1d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:20.796507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655926d-d1ec-4dbb-a381-81446d6c3a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:20.861037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0655926d-d1ec-4dbb-a381-81446d6c3a1d None None] MFA Rules not processed for user `71a9b049c29b464f93b8d5e2a3ac7a58`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:20.862333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0655926d-d1ec-4dbb-a381-81446d6c3a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:20.896024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8fcf46b7074c72b93bc0bbb366de69'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:20.896644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8fcf46b7074c72b93bc0bbb366de69'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:20.930281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8fcf46b7074c72b93bc0bbb366de69'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:20.944535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8fcf46b7074c72b93bc0bbb366de69'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:20.958595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8fcf46b7074c72b93bc0bbb366de69'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:20.969394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 851/1722] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:20 2021] DELETE /identity/v3/users/dd8fcf46b7074c72b93bc0bbb366de69 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:20.973567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:20.988415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.021186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 872/1723] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:20 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:21.022668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.022962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.023294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.062358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:21.063973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.108911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f655-ad40-4394-a2c6-53b1c529ae03 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:21.118118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:21.119598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.120049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.121168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] PATH_INFO: `/v3/projects/94580ff551b04feab72762d02a2ba7c6` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.123935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94580ff551b04feab72762d02a2ba7c6)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:21.127299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:21.161302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 873/1724] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:21.162323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:21.163854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.188286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac77552-f85b-4273-98ad-4108ba909748 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:21.224907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94580ff551b04feab72762d02a2ba7c6', 'request_id': 'req-3c117c32-3268-431c-b654-ec2bf5149e94'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.251193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94580ff551b04feab72762d02a2ba7c6', 'request_id': 'req-3c117c32-3268-431c-b654-ec2bf5149e94'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.262845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94580ff551b04feab72762d02a2ba7c6', 'request_id': 'req-3c117c32-3268-431c-b654-ec2bf5149e94'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.294263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] The token cache is being invalidate because project 94580ff551b04feab72762d02a2ba7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:21.295836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.298073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.303179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 852/1725] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:20 2021] DELETE /identity/v3/projects/94580ff551b04feab72762d02a2ba7c6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:21.304488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:21.309111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.312850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:21.314725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.315025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.316497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.318672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:21.324290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:21.390624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 874/1726] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:21 2021] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:21.391938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:21.394578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.431587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117c32-3268-431c-b654-ec2bf5149e94 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:21.519624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:21.520918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.522964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.524120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.529419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.635520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022aae-1168-4765-a9be-ad91f733f489 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:21.659744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:21.661265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.661770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.662414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] PATH_INFO: `/v3/users/6a7f55b988db41cb876246520ab80f5e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.665706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7f55b988db41cb876246520ab80f5e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:21.671654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:21.753190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:21.755376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:21.796240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7f55b988db41cb876246520ab80f5e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.798106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7f55b988db41cb876246520ab80f5e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.804612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 853/1727] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:21.805533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:21.810634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:21.829748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7f55b988db41cb876246520ab80f5e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.841925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7f55b988db41cb876246520ab80f5e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.842574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a15b79bb-dc90-4895-a170-40aa51a4620b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7f55b988db41cb876246520ab80f5e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:21.869309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7850a-4faf-43af-9373-4dc14badcd71 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:21.873482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 875/1728] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:21 2021] DELETE /identity/v3/users/6a7f55b988db41cb876246520ab80f5e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:21.877431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:21.877905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:21.882341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:21.952074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:21.955266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:22.102214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 876/1729] 10.222.0.41 () {58 vars in 1015 bytes} [Thu Nov 25 04:48:21 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:22.121860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.127097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.127798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.128419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.129355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.138596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.169033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.171322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:22.180951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 854/1730] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:21 2021] POST /identity/v3/users => generated 296 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:22.185121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.187567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:22.190998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad67ec3-7bf9-46fd-b150-ea26bc0c21f2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.199107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.199796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.200078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.202978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.218689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7d0a-c2fd-41f3-84ed-5aa1b2b1ceb6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.222012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.223528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.230507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.231810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.232499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.233415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.234704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.236787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.247710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 877/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:22.261748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 855/1732] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:22.266249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.284398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1df4e-211d-4070-966e-dd7c0b375358 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.290263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.292068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.292584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.293041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] PATH_INFO: `/v3/projects/38dfba8623e24390b5f85c2c17f0534c/users/d303188c1f3b42ce81c378205e87830f/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.324396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dfba8623e24390b5f85c2c17f0534c, user_id=d303188c1f3b42ce81c378205e87830f, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.327658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.358596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 878/1733] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:22 2021] PUT /identity/v3/projects/38dfba8623e24390b5f85c2c17f0534c/users/d303188c1f3b42ce81c378205e87830f/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:22.362714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.382401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665695-c47e-4587-9350-f493d12aa864 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.513749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.514410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.514728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.515391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.516198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.517995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.569457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 856/1734] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:22.571087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.613110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc112-5345-4351-bd40-1517183884b9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.633196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.635760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.637328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.639832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] PATH_INFO: `/v3/projects/38dfba8623e24390b5f85c2c17f0534c/users/d303188c1f3b42ce81c378205e87830f/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.646903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dfba8623e24390b5f85c2c17f0534c, user_id=d303188c1f3b42ce81c378205e87830f, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.655951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.657933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:22.658098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.680364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 879/1735] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:22 2021] PUT /identity/v3/projects/38dfba8623e24390b5f85c2c17f0534c/users/d303188c1f3b42ce81c378205e87830f/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:22.681781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:22.690992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:22.695631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127edc-3258-486f-b8a7-a545d2366f25 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.845811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed14859-cc83-429f-b963-05fd91852a11 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:22.851913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.852519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.852833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.853300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.885748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:22.887109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.887109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.887313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] PATH_INFO: `/v3/projects/b672d71d22864e7f92fda0ae6824fd53` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.888694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.890190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf4b1b-45d5-49c6-b7ee-09394f7cead4 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.890745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b672d71d22864e7f92fda0ae6824fd53)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:22.895789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:22.922550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 880/1736] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:22.926515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:22.927858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:22.929450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:22.982535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b672d71d22864e7f92fda0ae6824fd53', 'request_id': 'req-09129aa4-8b91-4406-a943-bfe73d4ba4d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:22.990005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b672d71d22864e7f92fda0ae6824fd53', 'request_id': 'req-09129aa4-8b91-4406-a943-bfe73d4ba4d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:22.996700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b672d71d22864e7f92fda0ae6824fd53', 'request_id': 'req-09129aa4-8b91-4406-a943-bfe73d4ba4d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:23.012281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] The token cache is being invalidate because project b672d71d22864e7f92fda0ae6824fd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:23.012688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:23.013471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-09129aa4-8b91-4406-a943-bfe73d4ba4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:23.015721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 857/1737] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:22 2021] DELETE /identity/v3/projects/b672d71d22864e7f92fda0ae6824fd53 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:23.021792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b5840-bafd-45c4-83d1-75fd0d1ab5f6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.022012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b5840-bafd-45c4-83d1-75fd0d1ab5f6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.022298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b5840-bafd-45c4-83d1-75fd0d1ab5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.027530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] MFA Rules not processed for user `d303188c1f3b42ce81c378205e87830f`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:23.028922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:23.068312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b64b5840-bafd-45c4-83d1-75fd0d1ab5f6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:23.073558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b64b5840-bafd-45c4-83d1-75fd0d1ab5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:23.169404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 881/1738] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:22 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:23.182967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.186727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:23.231127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 858/1739] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:23.241593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.241904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.242189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.277495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:23.280581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:23.301578 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c10ce-1e43-459f-a248-42981a8f10e8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.306162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 859/1740] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:23.312075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.313715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.314495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.314902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.315258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.322783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c577c5-035c-4de3-bb9c-d55a9de1f1e9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.327404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.329052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:23.343506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.343619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.343833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.344099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.345210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:23.345580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.345819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 882/1741] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:23 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:23.347648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:23.378048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 860/1742] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:23.378911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.411149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4e2c4-c375-4edc-a068-65fb664880bd service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.429351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.430063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.430335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.430634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.431473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.433675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:23.497462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 883/1743] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:23 2021] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:23.505578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.532929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b069b3-c162-4443-ad81-fd76ff825305 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.715611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.717027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.717027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.717027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.717967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.720083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:23.757998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 861/1744] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:23 2021] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:23.762738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.780781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da585f6-c177-4fcc-afc3-afa9fa78b962 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.800410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.801290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.801580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.804131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.805689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.812655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:23.892082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 884/1745] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:23.940972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.953349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bfb6f-1401-400c-b5b7-7d8ac3634ac1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:23.963947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:23.972517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:23.975443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:23.977458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:23.982397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:23.982702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:23.994159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.054229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 862/1746] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:24.056369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:24.095754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2740-d415-4d19-a353-32378efc5f96 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:24.112479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:24.115271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.116897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.117963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] PATH_INFO: `/v3/projects/a47732b18d1042899dbc356360b1c8bc/users/7fa98aede77a48e7bd4b9afce96b807e/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.164940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47732b18d1042899dbc356360b1c8bc, user_id=7fa98aede77a48e7bd4b9afce96b807e, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:24.176810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068b99d-93e9-4e32-8b7b-4044a4bd2979 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:24.180169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa981e5-42ac-4fa4-af06-ce8fe02596e7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.187093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd303188c1f3b42ce81c378205e87830f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dfba8623e24390b5f85c2c17f0534c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:24.188226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.188712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.189216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.190277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:24.190796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:24.192802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.222533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 863/1747] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:24 2021] PUT /identity/v3/projects/a47732b18d1042899dbc356360b1c8bc/users/7fa98aede77a48e7bd4b9afce96b807e/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:24.224977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.225391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.225756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.235402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 885/1748] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:24.240595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:24.267059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695dee2-fa37-4485-b39d-10ed4111bd49 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:24.301463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] MFA Rules not processed for user `7fa98aede77a48e7bd4b9afce96b807e`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:24.303605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:24.431799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd303188c1f3b42ce81c378205e87830f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dfba8623e24390b5f85c2c17f0534c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:24.432689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.433029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.433552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.434716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:24.438963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ab652-087d-4f77-b62a-cf45b8561a95 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.501230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 864/1749] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:24 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:24.506129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:24.521268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 886/1750] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:24 2021] POST /identity/v3/projects => generated 354 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:24.523142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda4c1-595d-40d8-8189-d4cf186a5dc2 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.523428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda4c1-595d-40d8-8189-d4cf186a5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.523701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda4c1-595d-40d8-8189-d4cf186a5dc2 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.526210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 887/1751] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:48:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:24.527062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccda4c1-595d-40d8-8189-d4cf186a5dc2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:24.642159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025ec7-f0f9-460a-b42d-234e5f1ff187 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:24.716548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccda4c1-595d-40d8-8189-d4cf186a5dc2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:24.728854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd303188c1f3b42ce81c378205e87830f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dfba8623e24390b5f85c2c17f0534c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:24.729609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.729942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.730192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.731030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:24.731333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:24.734091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cef08-1672-4814-a0bc-6de3d40f4fdc tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.762261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 888/1752] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:24.763605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.764213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.764213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.810211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:24.810984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:24.811252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:24.811573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:24.812492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:24.817672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:24.831421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:24.833602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:24.890650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 865/1753] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:24 2021] POST /identity/v3/projects => generated 369 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:24.891692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:24.975029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 889/1754] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:48:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:24.976302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:25.001479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd85ef5-c565-4a0d-b810-75391b415936 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.016412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698895f-8c48-4c33-b5e7-c696c9a004d3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.022198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd303188c1f3b42ce81c378205e87830f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dfba8623e24390b5f85c2c17f0534c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.023376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.023767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.023974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] PATH_INFO: `/v3/projects/cd4e1e28c0db4e9d8b0c10843626b51b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.025304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd4e1e28c0db4e9d8b0c10843626b51b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.027634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.088170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.089647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.090334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.091024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.092750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.095972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.099847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4e1e28c0db4e9d8b0c10843626b51b', 'request_id': 'req-7ef44553-3685-4f4e-894a-faa5b99d4dc7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:25.120984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4e1e28c0db4e9d8b0c10843626b51b', 'request_id': 'req-7ef44553-3685-4f4e-894a-faa5b99d4dc7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:25.147110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4e1e28c0db4e9d8b0c10843626b51b', 'request_id': 'req-7ef44553-3685-4f4e-894a-faa5b99d4dc7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:25.156759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 890/1755] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:24 2021] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:25.159133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:25.164898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:25.185486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] The token cache is being invalidate because project cd4e1e28c0db4e9d8b0c10843626b51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:25.186209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:25.189908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:25.193615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 866/1756] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:24 2021] DELETE /identity/v3/projects/cd4e1e28c0db4e9d8b0c10843626b51b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:25.204421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:25.208287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:25.390168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd4fa9-647e-48cd-8d8b-c471cb763cef admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.390548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef44553-3685-4f4e-894a-faa5b99d4dc7 tempest-VolumeQuotaClassesTest-676912783 tempest-VolumeQuotaClassesTest-676912783-project-admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.402693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.403971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.406330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.407351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.409017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.411869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a122169-91f4-4508-ab56-9c81ad7555d5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.437965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 867/1757] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:25 2021] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:25.439777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.440307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.440802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.558115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] MFA Rules not processed for user `cf5c43b0d61241578cf162de6aa559d7`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:25.559856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:25.619672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.620540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.627826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.629143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.640426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:25.690609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.698302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.746499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 868/1758] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:25.747759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:25.780918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 891/1759] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:25.784198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:25.793461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:25.794571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f30532-aaac-4ebb-a68e-38fbdec33d49 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.816531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.820474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.822455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.822455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] PATH_INFO: `/v3/projects/576e7369b33f40abaf495f692bccf79e/users/d845ee9ed3b64c1892bf16822884a6dd/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.863426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f4ad-ee50-402e-9bba-5c743a63394f service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:25.864609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576e7369b33f40abaf495f692bccf79e, user_id=d845ee9ed3b64c1892bf16822884a6dd, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.876515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e12f9-cb8b-4d8f-8acf-aef636b1a8e4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.886075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:25.890378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.891070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.891366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] PATH_INFO: `/v3/users/71a9b049c29b464f93b8d5e2a3ac7a58` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:25.902818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a9b049c29b464f93b8d5e2a3ac7a58)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:25.904884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:25.911223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 869/1760] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:25 2021] PUT /identity/v3/projects/576e7369b33f40abaf495f692bccf79e/users/d845ee9ed3b64c1892bf16822884a6dd/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:25.924529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:25.925042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:25.925514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:26.012415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] MFA Rules not processed for user `cf5c43b0d61241578cf162de6aa559d7`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:26.028684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:26.150455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a9b049c29b464f93b8d5e2a3ac7a58'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.153252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a9b049c29b464f93b8d5e2a3ac7a58'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.204310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a9b049c29b464f93b8d5e2a3ac7a58'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.218591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 870/1761] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:26.219736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:26.225134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:26.252708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a9b049c29b464f93b8d5e2a3ac7a58'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.253933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a9b049c29b464f93b8d5e2a3ac7a58'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.306108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 892/1762] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:25 2021] DELETE /identity/v3/users/71a9b049c29b464f93b8d5e2a3ac7a58 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:26.310875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:26.317293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:26.486422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c76d-06f5-4678-96a3-13f5cd2608bb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:26.538737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95534dd-0e71-49b6-a645-d955f91b65d0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:26.549229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:26.550631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:26.551022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:26.551565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:26.552521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:26.558289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:26.594495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 893/1763] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:26.597707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:26.605652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:26.653384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65333501-959a-4c29-bdf7-cd17dfe356ee admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:26.677430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:26.682223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:26.682518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:26.682737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] PATH_INFO: `/v3/projects/17bb1a8800d74be6a65d51f4a5209910` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:26.684965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17bb1a8800d74be6a65d51f4a5209910)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:26.694123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:26.719427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:26.720358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:26.720643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:26.720920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] PATH_INFO: `/v3/projects/3876fed1eadf48b494c056a5cb9a7afd` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:26.731672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3876fed1eadf48b494c056a5cb9a7afd)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:26.738848 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:26.803040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17bb1a8800d74be6a65d51f4a5209910', 'request_id': 'req-a77212b7-c6e6-42e4-879e-9db34df01ce0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.818726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17bb1a8800d74be6a65d51f4a5209910', 'request_id': 'req-a77212b7-c6e6-42e4-879e-9db34df01ce0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.834786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17bb1a8800d74be6a65d51f4a5209910', 'request_id': 'req-a77212b7-c6e6-42e4-879e-9db34df01ce0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.860324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3876fed1eadf48b494c056a5cb9a7afd', 'request_id': 'req-34af50f5-7e05-41b2-a5bf-11160f075c90'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.869469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] The token cache is being invalidate because project 17bb1a8800d74be6a65d51f4a5209910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:26.874114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.875730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a77212b7-c6e6-42e4-879e-9db34df01ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.889908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 894/1764] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:26 2021] DELETE /identity/v3/projects/17bb1a8800d74be6a65d51f4a5209910 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:26.891586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:26.894362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3876fed1eadf48b494c056a5cb9a7afd', 'request_id': 'req-34af50f5-7e05-41b2-a5bf-11160f075c90'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.896348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:26.896626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:26.930594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3876fed1eadf48b494c056a5cb9a7afd', 'request_id': 'req-34af50f5-7e05-41b2-a5bf-11160f075c90'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.977141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] The token cache is being invalidate because project 3876fed1eadf48b494c056a5cb9a7afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:26.977454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.979633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:26.984753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:26.988975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:26.992250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 871/1765] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:26 2021] DELETE /identity/v3/projects/3876fed1eadf48b494c056a5cb9a7afd => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:26.999460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:27.006488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.239662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 895/1766] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:27.240622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:27.246520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.265782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af50f5-7e05-41b2-a5bf-11160f075c90 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:27.282997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:27.284579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:27.286066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:27.286393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] PATH_INFO: `/v3/projects/576e7369b33f40abaf495f692bccf79e/users/d845ee9ed3b64c1892bf16822884a6dd/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:27.297303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] RBAC: Authorizing `identity:create_grant(project_id=576e7369b33f40abaf495f692bccf79e, user_id=d845ee9ed3b64c1892bf16822884a6dd, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:27.306009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9831a-117e-4d0c-a3d0-30661b58764f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:27.344427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 872/1767] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:26 2021] PUT /identity/v3/projects/576e7369b33f40abaf495f692bccf79e/users/d845ee9ed3b64c1892bf16822884a6dd/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:27.348053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:27.348362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:27.348639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:27.424018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:27.428490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.469581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2ea7-15c8-4524-b91d-c1aed000e40c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:27.574732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:27.575488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:27.575976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:27.576308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:27.584763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.637684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 873/1768] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:27.638663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:27.645269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.689308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a62232-91d0-4016-8edd-90a3c0fa4d5a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:27.702062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:27.705743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:27.710233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:27.711342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:27.711626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:27.711904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] PATH_INFO: `/v3/users/cc427a742b05458bb9a48dcf66da2d27` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:27.716368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc427a742b05458bb9a48dcf66da2d27)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:27.718354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:27.749651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 896/1769] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:27 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:27.751737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:27.753738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.940714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc427a742b05458bb9a48dcf66da2d27'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:27.943864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692effc-dfb5-4a08-bf0e-5a5f4fe67196 service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:27.951495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc427a742b05458bb9a48dcf66da2d27'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:27.973953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:27.974897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:27.975283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:27.979765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:27.983237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:27.994563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc427a742b05458bb9a48dcf66da2d27'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:28.012616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc427a742b05458bb9a48dcf66da2d27'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:28.020627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:28.022439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7de0a-3f84-451d-b035-cfa80985196b service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:28.033780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c7ef60b1-cf4d-4ba1-8f88-f8606c5a002f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc427a742b05458bb9a48dcf66da2d27'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:28.053007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 874/1770] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:27 2021] DELETE /identity/v3/users/cc427a742b05458bb9a48dcf66da2d27 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:28.057819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.058110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.058392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.063463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 897/1771] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:28.065498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dcc2-b922-4274-95ce-05a0194a66b1 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.076625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dcc2-b922-4274-95ce-05a0194a66b1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.077186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dcc2-b922-4274-95ce-05a0194a66b1 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.079864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 898/1772] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:48:28 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:28.081286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.081748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.082164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.122291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:28.125809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:28.147617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] MFA Rules not processed for user `d845ee9ed3b64c1892bf16822884a6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:28.148840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:28.325836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 875/1773] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:28 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:28.342706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.345071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:28.416979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 899/1774] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:28.417830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.454468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd2af-d014-4a82-8055-f7c748fd4f93 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:28.471999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:28.472692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.473038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.476674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.479876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:28.480205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:28.490530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36f2c9-f95f-4cff-8fd6-d76e9189b130 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:28.523058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 900/1775] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:28.530489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.530783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.531135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.532684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd27a-6a1a-4912-b005-6dde38fc4fb6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:28.552856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:28.553862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.554305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.554728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.591036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:28.591279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:28.592447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:28.593398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:28.640300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 876/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:28 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:28.642244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.694340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676be539-247a-4f1b-85af-fa701bfce86a service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:28.702359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:28.703427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.703898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.704383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.705340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:28.707544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:28.782716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 877/1777] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:28 2021] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:28.784955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.875943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 901/1778] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:48:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:28.876321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.879348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:28.903000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f84f4-9ee6-4dd1-8184-c8441984c037 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:28.942772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03804a-7666-446b-ad8a-9162caa03dfa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:28.953000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:28.953699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.953983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.954280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:28.954973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:28.957158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:28.995537 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 878/1779] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:28 2021] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:28.995828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:28.997697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:28.998268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:28.998558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:28.998834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.004017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:29.018732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7540b-ac3d-4e59-978e-bb0c010e4247 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:29.023979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:29.024814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.025187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.025523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.026415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:29.032732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:29.062666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 879/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:28 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:29.067813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:29.092831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193adb-3c2f-4b58-9a1e-ca5a0cff88d9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:29.114420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:29.116084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.118184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.119260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.120664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:29.124910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d793f7-6345-4539-965c-da475ab3ec65 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:29.137316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:29.139012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:29.155025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 902/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:28 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:29.158362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 880/1782] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:29 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:29.173233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:29.251212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1960b37-fbe9-4bde-8e4a-2421db798714 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:29.269432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:29.270394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.270690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.278024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] PATH_INFO: `/v3/projects/3b0456afb2f64338934739eb9e7e183e/users/4ad3e3e0e16646018ffcb1e555389291/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.332059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0456afb2f64338934739eb9e7e183e, user_id=4ad3e3e0e16646018ffcb1e555389291, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:29.352250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:29.394168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 903/1783] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:29 2021] PUT /identity/v3/projects/3b0456afb2f64338934739eb9e7e183e/users/4ad3e3e0e16646018ffcb1e555389291/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:29.471490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.471781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.472097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.499872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:29.501731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:29.542825 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] MFA Rules not processed for user `4ad3e3e0e16646018ffcb1e555389291`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:29.547145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:29.757029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74bb61-aaa8-471a-a6d9-b37dddb774e9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:29.778108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:29.783929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.784606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.785104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:29.805174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:29.807290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:29.826790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 881/1784] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:29.855784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 904/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:29.938447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:29.970618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7f249-a84f-468e-9936-d0d792429c61 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:29.993997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:29.994612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:29.994899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:29.995193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:30.013312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:30.017504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:30.038725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 882/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:30.333209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:30.334657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:30.511508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:30.512995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:30.539992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c792c-be98-436f-836a-fc1d889ce567 service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:30.554156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4988-60f0-4c00-9463-da7ec4b030c6 service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:30.564835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:30.566144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:30.566559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:30.567381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] PATH_INFO: `/v3/projects/ed4555b6f0734b2da2f55a3b87efb863` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:30.573156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4555b6f0734b2da2f55a3b87efb863)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:30.577889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:30.585140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:30.587653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:30.592242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:30.593489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] PATH_INFO: `/v3/projects/674ae8000ffd4d1f87689fb92b487e2c` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:30.600277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674ae8000ffd4d1f87689fb92b487e2c)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:30.608812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:30.709339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4555b6f0734b2da2f55a3b87efb863', 'request_id': 'req-52807682-3a3f-4520-9298-140bdc652dba'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.716422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674ae8000ffd4d1f87689fb92b487e2c', 'request_id': 'req-d8055c06-b667-4e1e-adeb-3b899722ad03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.723617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4555b6f0734b2da2f55a3b87efb863', 'request_id': 'req-52807682-3a3f-4520-9298-140bdc652dba'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.725812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674ae8000ffd4d1f87689fb92b487e2c', 'request_id': 'req-d8055c06-b667-4e1e-adeb-3b899722ad03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.737913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674ae8000ffd4d1f87689fb92b487e2c', 'request_id': 'req-d8055c06-b667-4e1e-adeb-3b899722ad03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.738074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4555b6f0734b2da2f55a3b87efb863', 'request_id': 'req-52807682-3a3f-4520-9298-140bdc652dba'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.758945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] The token cache is being invalidate because project ed4555b6f0734b2da2f55a3b87efb863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:30.759507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.760470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.762068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 883/1787] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:30 2021] DELETE /identity/v3/projects/ed4555b6f0734b2da2f55a3b87efb863 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:30.766250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:30.767798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:30.788580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] The token cache is being invalidate because project 674ae8000ffd4d1f87689fb92b487e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:30.789081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.792295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d8055c06-b667-4e1e-adeb-3b899722ad03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:30.799522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 905/1788] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:30 2021] DELETE /identity/v3/projects/674ae8000ffd4d1f87689fb92b487e2c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:30.807547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d687-1949-4d91-be96-7693d66ac083 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:30.808055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d687-1949-4d91-be96-7693d66ac083 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:30.808368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304d687-1949-4d91-be96-7693d66ac083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:30.878113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f304d687-1949-4d91-be96-7693d66ac083 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:30.883710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f304d687-1949-4d91-be96-7693d66ac083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:30.971450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52807682-3a3f-4520-9298-140bdc652dba admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:31.052229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 906/1789] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:31.053985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf1ca-0bfc-4255-9737-951ba0efa196 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.053985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf1ca-0bfc-4255-9737-951ba0efa196 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.054264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf1ca-0bfc-4255-9737-951ba0efa196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.077109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:31.080892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.080892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.082029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] PATH_INFO: `/v3/users/d303188c1f3b42ce81c378205e87830f` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.083509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d303188c1f3b42ce81c378205e87830f)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:31.086311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:31.106191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ccecf1ca-0bfc-4255-9737-951ba0efa196 None None] MFA Rules not processed for user `cf5c43b0d61241578cf162de6aa559d7`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:31.107427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ccecf1ca-0bfc-4255-9737-951ba0efa196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:31.149179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd303188c1f3b42ce81c378205e87830f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.150526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd303188c1f3b42ce81c378205e87830f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.168199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd303188c1f3b42ce81c378205e87830f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.177696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd303188c1f3b42ce81c378205e87830f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.192977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd303188c1f3b42ce81c378205e87830f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.204180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 884/1790] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:30 2021] DELETE /identity/v3/users/d303188c1f3b42ce81c378205e87830f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:31.205306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:31.206934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:31.299137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 907/1791] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:31 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:31.313768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.314065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.314325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.317405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edeee3-b745-4f42-8ed1-e93c746ea560 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:31.324995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:31.325841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.326350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.326459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] PATH_INFO: `/v3/users/4ad3e3e0e16646018ffcb1e555389291` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.328141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad3e3e0e16646018ffcb1e555389291)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:31.330736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:31.395133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:31.399967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:31.434720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 908/1792] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:31.436760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad3e3e0e16646018ffcb1e555389291'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.438597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad3e3e0e16646018ffcb1e555389291'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.439529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:31.463105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f19a44-539f-44dd-b44a-abd7ec83cb23 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:31.471300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:31.471990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.472302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.472580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.473338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:31.473648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:31.482179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:31.483532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad3e3e0e16646018ffcb1e555389291'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.497258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad3e3e0e16646018ffcb1e555389291'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.517772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f50b9996-bf2a-48aa-b71c-4fae2f71eae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad3e3e0e16646018ffcb1e555389291'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:31.537003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 909/1793] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:31.537224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 885/1794] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:31 2021] DELETE /identity/v3/users/4ad3e3e0e16646018ffcb1e555389291 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:31.539008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.539301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.539504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:31.539604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.544119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:31.591568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:31.595002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626cd6-5886-4939-a8a0-0717f47e00ba admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:31.595923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:31.729712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:31.730415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:31.730696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:31.730970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:31.734243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:31.738235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:31.744187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 886/1795] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:31.785332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:31.793581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 910/1796] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:31 2021] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:31.805321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889f6b3-03d3-4779-b3d6-15c8ba4c6ba7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:31.907042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:31.909959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.035946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.036811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.037210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.039390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.039390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.042701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.053422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708eda9-da21-44db-bbc6-7f1937b51c25 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.057806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.058532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.058849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.059163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.071283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.073912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b98d7-74de-48a1-ac4e-20ae52666ba7 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.083628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 887/1797] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:31 2021] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:32.088975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.094657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 911/1798] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:32.106185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919f0b5-20f3-424d-8b2b-dcba52c89337 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.112171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.112978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.113356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.113885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.114596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.116327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.128458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318a6b-fd39-426b-85f1-a4a0c9337ea0 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.132815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 888/1799] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:32 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:32.134424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.138082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318a6b-fd39-426b-85f1-a4a0c9337ea0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.140515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318a6b-fd39-426b-85f1-a4a0c9337ea0 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.148956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef53456-e7e7-4466-a3a6-eb233c4a6310 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.153376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 912/1800] 10.222.0.36 () {54 vars in 912 bytes} [Thu Nov 25 04:48:32 2021] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:48:32.157177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.158060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.158560 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.159149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.160083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.162541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.164270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.164732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.165748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.182726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 889/1801] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:32 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:32.183094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.204883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.211736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:32.213563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.220875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 913/1802] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:32.222261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.235528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69825043-2791-4933-a88c-524e6b4ca8ea None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.240852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.241326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f7c79-7909-4715-be0a-26b02571fa33 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.242306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.242519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.242934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] PATH_INFO: `/v3/projects/dd5d8d17ff04496eb1bb7911bafbb289/users/83b1de4ed329414db502b2f0e865cdca/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.250375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.251902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.252855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.253298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] PATH_INFO: `/v3/projects/38dfba8623e24390b5f85c2c17f0534c` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.255101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38dfba8623e24390b5f85c2c17f0534c)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.258506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.260635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5d8d17ff04496eb1bb7911bafbb289, user_id=83b1de4ed329414db502b2f0e865cdca, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.263412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.301542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 914/1803] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:32 2021] PUT /identity/v3/projects/dd5d8d17ff04496eb1bb7911bafbb289/users/83b1de4ed329414db502b2f0e865cdca/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:32.301542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.308559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.355881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38dfba8623e24390b5f85c2c17f0534c', 'request_id': 'req-3cb1e6f2-756f-45ec-879a-a6f194b626a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:32.364431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38dfba8623e24390b5f85c2c17f0534c', 'request_id': 'req-3cb1e6f2-756f-45ec-879a-a6f194b626a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:32.371207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38dfba8623e24390b5f85c2c17f0534c', 'request_id': 'req-3cb1e6f2-756f-45ec-879a-a6f194b626a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:32.388989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] The token cache is being invalidate because project 38dfba8623e24390b5f85c2c17f0534c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:32.389572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:32.390411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3cb1e6f2-756f-45ec-879a-a6f194b626a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:32.402072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 890/1804] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:32 2021] DELETE /identity/v3/projects/38dfba8623e24390b5f85c2c17f0534c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:32.402072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae434-cfa0-4de9-ae32-c7b37eebec3f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.402072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae434-cfa0-4de9-ae32-c7b37eebec3f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.402072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae434-cfa0-4de9-ae32-c7b37eebec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.418422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6268d3-9ef8-4f69-ac32-372cfccc084d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.439378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-beaae434-cfa0-4de9-ae32-c7b37eebec3f None None] MFA Rules not processed for user `83b1de4ed329414db502b2f0e865cdca`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:32.440887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-beaae434-cfa0-4de9-ae32-c7b37eebec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.525139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.526350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.526635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.526908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.529803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.533393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 891/1805] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:32.535286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6403a-e9d4-4e02-a6bc-4c5b09f7a091 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.535925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6403a-e9d4-4e02-a6bc-4c5b09f7a091 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.536626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6403a-e9d4-4e02-a6bc-4c5b09f7a091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.550560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.552357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.559251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-98d6403a-e9d4-4e02-a6bc-4c5b09f7a091 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:32.560664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-98d6403a-e9d4-4e02-a6bc-4c5b09f7a091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.575045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 915/1806] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:32.576076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.579062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.673539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 892/1807] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:32.675648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.676166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.679342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.709797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998458fd-ed37-4aa4-8dd3-d263c8f67b96 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.711177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:32.713903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:32.718118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.719151 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.719805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.721572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.722782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.725678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.736040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 893/1808] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:32.739012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.756455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1f1f-027c-49ce-932e-9d4a2b1eccff None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.764252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.765219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.765502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.765903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.766525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 916/1809] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:32.768109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:32.768612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.770528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.771177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:32.793924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 894/1810] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:32.801579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:32.825273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a84933-bd98-42ce-9da2-31dece5aa00f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.931452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87001b-0f04-44c7-ae03-8a09bc2095ce admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:32.937526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:32.938243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:32.938575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:32.938856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:32.939628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:32.941852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d5e9c-66ff-4c3c-aeff-52529a01622e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.000400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 917/1811] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:33.000400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.001347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.001749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.032085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.032792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.033077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.033360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.034075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.035987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.086360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] MFA Rules not processed for user `5010bab96b044f0d8d70c422ac1a5ade`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:33.087352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 895/1812] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/projects => generated 401 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:33.088110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:33.088509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.257546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa939a-6043-467c-8dad-f7e378b40af1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.277595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.278301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.278583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.278855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.279618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.281268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.296877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 896/1813] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:33 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:33.296877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.302374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 918/1814] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:32 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:33.303626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.305690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065063a5-d711-435c-9d97-4f81d4bf940b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.311950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.313007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.313308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.313583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.314359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.316459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.337508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e601d1-2174-4446-90b8-5ffd964faccf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.351508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.352982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.354455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.356487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] PATH_INFO: `/v3/projects/a42c119710e341ce916f95ffff0313bc/users/8d02692d972b43c3bb8210f7d3aee8db/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.361678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 897/1815] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:33 2021] POST /identity/v3/users => generated 301 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:33.362864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.369390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:33.388010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42c119710e341ce916f95ffff0313bc, user_id=8d02692d972b43c3bb8210f7d3aee8db, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.392056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.414430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 919/1816] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:33 2021] PUT /identity/v3/projects/a42c119710e341ce916f95ffff0313bc/users/8d02692d972b43c3bb8210f7d3aee8db/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:33.415988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.506515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf428-aa46-42bb-9321-5155f57640cf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.532573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12b081-c3ef-4f39-af06-aa9afb3e2312 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.549785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.550603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.551455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.551455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.552379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.554216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.595120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 920/1817] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:33 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:33.596336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.639222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a7e5-01b5-46bb-a02e-f23da7b03ed4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.653120 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.654231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.655497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.655497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.658919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.659808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.660266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.660710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.661605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.666419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.712281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 921/1818] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:33 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:33.714924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.743157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.747730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.753830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fb55-15bb-4e5b-86ff-938fab8de700 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.768591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.769147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 898/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:33 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:33.769357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.769615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.769893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.770658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.770768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.772284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.791637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986b5b1-1139-4cbd-a75f-22a60cae14e1 service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.795554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 922/1820] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:33 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:33.799663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:33.804400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.805579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.806016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.806316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] PATH_INFO: `/v3/projects/a42c119710e341ce916f95ffff0313bc/users/8d02692d972b43c3bb8210f7d3aee8db/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.809779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42c119710e341ce916f95ffff0313bc, user_id=8d02692d972b43c3bb8210f7d3aee8db, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:33.813060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3a7b-8273-4f51-b0a3-3922e677c941 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:33.833322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414e9d7-6fc6-4a82-9082-d81fbec389bf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:33.837583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 899/1821] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:33 2021] PUT /identity/v3/projects/a42c119710e341ce916f95ffff0313bc/users/8d02692d972b43c3bb8210f7d3aee8db/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:33.841011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.841531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.844383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:33.911673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] MFA Rules not processed for user `8d02692d972b43c3bb8210f7d3aee8db`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:33.913017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:33.988687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:33.989627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:33.989913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:33.990191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] PATH_INFO: `/v3/projects/c2e8839b76e6484a87220f318fa72bb6/users/6e310db744bc46deb32146c5e102301b/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.019918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e8839b76e6484a87220f318fa72bb6, user_id=6e310db744bc46deb32146c5e102301b, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:34.025617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:34.060216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 923/1822] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:33 2021] PUT /identity/v3/projects/c2e8839b76e6484a87220f318fa72bb6/users/6e310db744bc46deb32146c5e102301b/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:34.060216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:34.068384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.089251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 900/1823] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:33 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:34.090281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:34.091994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.110170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdfa99-b60c-4cac-b7f3-b0396e4f7140 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:34.143044 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e55ec-9623-43d7-99fe-e145b7e03e5b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:34.148340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:34.149401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.149729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.150065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] PATH_INFO: `/v3/users/7fa98aede77a48e7bd4b9afce96b807e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.151785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa98aede77a48e7bd4b9afce96b807e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:34.154252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:34.206012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:34.207571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.208389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.209536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] PATH_INFO: `/v3/projects/3b0456afb2f64338934739eb9e7e183e` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.212525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0456afb2f64338934739eb9e7e183e)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:34.215936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:34.236038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa98aede77a48e7bd4b9afce96b807e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.237444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa98aede77a48e7bd4b9afce96b807e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.254113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa98aede77a48e7bd4b9afce96b807e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.266454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa98aede77a48e7bd4b9afce96b807e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.268120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1d6a7ad2-685d-4211-82ca-183f280de637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa98aede77a48e7bd4b9afce96b807e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.293124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 924/1824] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:34 2021] DELETE /identity/v3/users/7fa98aede77a48e7bd4b9afce96b807e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:34.295575 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87669-1d0f-488a-9a6f-9475129a203b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.296242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87669-1d0f-488a-9a6f-9475129a203b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.296753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87669-1d0f-488a-9a6f-9475129a203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.306533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0456afb2f64338934739eb9e7e183e', 'request_id': 'req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.323035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0456afb2f64338934739eb9e7e183e', 'request_id': 'req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.338463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0456afb2f64338934739eb9e7e183e', 'request_id': 'req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.366046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4eb87669-1d0f-488a-9a6f-9475129a203b None None] MFA Rules not processed for user `6e310db744bc46deb32146c5e102301b`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:34.368013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4eb87669-1d0f-488a-9a6f-9475129a203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.372069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] The token cache is being invalidate because project 3b0456afb2f64338934739eb9e7e183e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:34.372392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.375006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:34.376996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 901/1825] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:34 2021] DELETE /identity/v3/projects/3b0456afb2f64338934739eb9e7e183e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:34.382326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:34.384996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.455356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 925/1826] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:34.455356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70d17-32c5-491d-a335-1214ae111d40 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.455356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70d17-32c5-491d-a335-1214ae111d40 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.455356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f70d17-32c5-491d-a335-1214ae111d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.497951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b7f70d17-32c5-491d-a335-1214ae111d40 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:34.499899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7f70d17-32c5-491d-a335-1214ae111d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.526530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c124f6-0a67-4442-88b5-7ec0be6c9c0e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:34.644019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 926/1827] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:34.649826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:34.651507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.653840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.654131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.654301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.654583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.656904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.658989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.697550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:34.700135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.721796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 927/1828] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:34.724054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:34.730954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.753963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd619c48-10ca-46b0-b1ff-e5a703a82907 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:34.769028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:34.769749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.770031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.770306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.771051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:34.774282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3dcd-e50c-4ef9-be44-f1c83d84ba52 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:34.781570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:34.783214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:34.795994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 902/1829] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:34 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:34.797518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:34.799453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.844103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 928/1830] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:34.847537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:34.848030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:34.848461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:34.900587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:34.902094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:34.955329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39209-baa5-4688-bb07-f1f2586ba8a2 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:34.995304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 929/1831] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:35.002289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.036230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc7191-58ca-483e-8aee-ea9688e22acc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.041661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.042509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.043108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.043236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.045280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.047915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.089922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 930/1832] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:34 2021] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:35.091390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.111775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.112540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc954a1-1eed-42a9-a48b-14e19766c529 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.113885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.114303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.114725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.133031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.134607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.135302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.135782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.137533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:35.138059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.140109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.149832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.152838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.164266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 931/1833] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:35.165716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.168046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:35.181741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 903/1834] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:35.182493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.183501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56fe6-8010-4ab5-a562-550c2a6b135c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.189921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.191684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.192259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.192741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] PATH_INFO: `/v3/users/83b1de4ed329414db502b2f0e865cdca` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.195323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b1de4ed329414db502b2f0e865cdca)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.201698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.204609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b4e1-9f65-4727-9351-a23535e9b5a6 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.218024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.218731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.219010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.219280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.220063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.221806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.253027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 904/1835] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:35.253675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.278721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed95929-450b-45d6-b8e0-821569dde206 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.298721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.299789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.299789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.299994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.300735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.302692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.317977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b1de4ed329414db502b2f0e865cdca'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:35.318922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b1de4ed329414db502b2f0e865cdca'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:35.336275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b1de4ed329414db502b2f0e865cdca'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:35.353252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b1de4ed329414db502b2f0e865cdca'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:35.357493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b1de4ed329414db502b2f0e865cdca'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:35.381778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 905/1836] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:35 2021] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:35.385189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.392319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:35.399364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 932/1837] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:35 2021] DELETE /identity/v3/users/83b1de4ed329414db502b2f0e865cdca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:35.401251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.410358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:35.574823 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957461ae-289d-41a4-8abe-940afcca1af1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.582773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f36a6-ad6c-480f-a5ab-e1d7add8a9af admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.585750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.587035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.587422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.588367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] PATH_INFO: `/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a/users/f869a04a483d4789b4878300c0d48db0/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.595728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.600884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.601325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.601708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.602818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.606234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864a2d-91c7-4bac-b3a8-f07f88605a50 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.623401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb80a7994b14cf0b2de6c5199d5409a, user_id=f869a04a483d4789b4878300c0d48db0, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.626386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.652604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 933/1838] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:35 2021] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:35.656027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.656478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.657058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.665298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 906/1839] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:35 2021] PUT /identity/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a/users/f869a04a483d4789b4878300c0d48db0/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:35.666487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.702989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:35.704989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:35.800268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085cc67-c3fa-461c-a0c4-ccb5ec549b4b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.812906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.813646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.814055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.814336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.815166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.816796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.837226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 934/1840] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:35.840006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.854304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 907/1841] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:35.857953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.870969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336f351-4780-4863-a7ac-9a8578bfc488 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.882116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2aa5-76ac-4c40-aa10-b8f642963d65 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.891470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.894484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.895011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.897067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.901262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.901654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.902720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.903059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.903342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:35.904174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:35.905765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.906148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:35.925197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 908/1842] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:35.926102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.928092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:35.938701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 935/1843] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:35.941979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:35.964008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55b51-bc95-4f49-b2b3-8dc33b387936 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:35.997717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:35.998820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:35.998945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:35.999167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] PATH_INFO: `/v3/projects/69821a12fbfa41bf844ddfc834919946/users/fa77c69b1cb8471b91bafcd7f1565e06/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.028926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e872de9-bd7d-4480-8be8-3c6debb3e7a3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.033548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69821a12fbfa41bf844ddfc834919946, user_id=fa77c69b1cb8471b91bafcd7f1565e06, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.035327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.036391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.036513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.037039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.037712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.050760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.053397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78ea63-b14b-4b07-b656-4cbb644a19c3 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.062743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 936/1844] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:35 2021] PUT /identity/v3/projects/69821a12fbfa41bf844ddfc834919946/users/fa77c69b1cb8471b91bafcd7f1565e06/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:36.063730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.074293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 909/1845] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:36.075849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.076173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.076530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.108625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] MFA Rules not processed for user `fa77c69b1cb8471b91bafcd7f1565e06`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:36.109983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:36.232915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb981e-d42e-44da-971a-9e06da9b407f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.244005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.245356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.245645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.245921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] PATH_INFO: `/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a/users/f869a04a483d4789b4878300c0d48db0/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.246580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 910/1846] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:36 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:36.251419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.252917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb80a7994b14cf0b2de6c5199d5409a, user_id=f869a04a483d4789b4878300c0d48db0, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.255979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf9cc6-e6a3-41c5-827e-51018c4bc540 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.268869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 937/1847] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:36 2021] PUT /identity/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a/users/f869a04a483d4789b4878300c0d48db0/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:36.270309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4285831-0ded-4020-abe0-39c9b2e6b2fe None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.281743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.282105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.282413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.345647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] MFA Rules not processed for user `f869a04a483d4789b4878300c0d48db0`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:36.347464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:36.365634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.366734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.367233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.367842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.369086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.371516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.419285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 911/1848] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:36 2021] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:36.420387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.509536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 938/1849] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:36 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:36.521124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.522546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:36.523054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7189-523f-4c49-ab5d-fa78f217f9f7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.541201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.541914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.542200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.542478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.543558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.548834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.631435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 912/1850] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:36 2021] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:36.632989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.655988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739a79-b602-4d50-9757-7c4494116c8c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.666702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.667929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.668280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.668542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.669503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.671491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.682441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14463b2-fb96-4549-a14d-dbde7c689d91 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.694664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 913/1851] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:36 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:36.695619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.699081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:36.716435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710324-5b25-4d26-895c-842cdb4ae249 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:36.722327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.723249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.723535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.723837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] PATH_INFO: `/v3/projects/a47732b18d1042899dbc356360b1c8bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.725681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47732b18d1042899dbc356360b1c8bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.728529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.800205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:36.803415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:36.803783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:36.804143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:36.846219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47732b18d1042899dbc356360b1c8bc', 'request_id': 'req-ac5b7bf8-881a-4988-92da-68b5cdd71619'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:36.858565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47732b18d1042899dbc356360b1c8bc', 'request_id': 'req-ac5b7bf8-881a-4988-92da-68b5cdd71619'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:36.877257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47732b18d1042899dbc356360b1c8bc', 'request_id': 'req-ac5b7bf8-881a-4988-92da-68b5cdd71619'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:36.898951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] The token cache is being invalidate because project a47732b18d1042899dbc356360b1c8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:36.899530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:36.900749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:36.904549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 914/1852] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:36 2021] DELETE /identity/v3/projects/a47732b18d1042899dbc356360b1c8bc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:36.906976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:36.910617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:36.959198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:36.961845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:36.983177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 939/1853] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:36 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:36.985546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.006457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a1cb-5681-45ef-b65c-a2f8fa958590 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.084391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7bf8-881a-4988-92da-68b5cdd71619 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.101735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.103191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.103742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.105050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] PATH_INFO: `/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1/users/dd0a55b875414559a0dc57b7f682abe9/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.124333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dafd80b9df5486dbc9ac65b00a270f1, user_id=dd0a55b875414559a0dc57b7f682abe9, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.128996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.136918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.142508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.142937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.144419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] PATH_INFO: `/v3/users/d845ee9ed3b64c1892bf16822884a6dd` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.148059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d845ee9ed3b64c1892bf16822884a6dd)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.154889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 915/1854] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:36 2021] PUT /identity/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1/users/dd0a55b875414559a0dc57b7f682abe9/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:37.155969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.156511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.167958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.239665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd845ee9ed3b64c1892bf16822884a6dd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.240544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd845ee9ed3b64c1892bf16822884a6dd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.273802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd845ee9ed3b64c1892bf16822884a6dd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.293630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd845ee9ed3b64c1892bf16822884a6dd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.294467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd845ee9ed3b64c1892bf16822884a6dd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.324917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 940/1855] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:36 2021] DELETE /identity/v3/users/d845ee9ed3b64c1892bf16822884a6dd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:37.327105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.329099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be963-9e24-4f69-8f63-edaae289756d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.330975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.455241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.456813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.457117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.457402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.460119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.466895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f701aa-f4c3-42f9-9eba-7250440bd33f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.476539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.478277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.479072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.479747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.481771 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.485482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.518141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 941/1856] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:37 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:37.521896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.552677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d815b-c6b8-4a28-a6c9-7cc554af02d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.591976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.595350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.596964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.598441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] PATH_INFO: `/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1/users/dd0a55b875414559a0dc57b7f682abe9/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.604268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dafd80b9df5486dbc9ac65b00a270f1, user_id=dd0a55b875414559a0dc57b7f682abe9, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.608286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.624441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.639809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2435-9c07-4cff-aef0-c3d861b4678f service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.664270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 942/1857] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:37 2021] PUT /identity/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1/users/dd0a55b875414559a0dc57b7f682abe9/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:37.665374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.666845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 916/1858] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:37 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:37.667417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.668266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.668632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.668918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.723316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] MFA Rules not processed for user `dd0a55b875414559a0dc57b7f682abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:37.728399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.809480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc483592-af32-4afa-9cea-13f8db4d0c69 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:37.818820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:37.819777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:37.820069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:37.828079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] PATH_INFO: `/v3/projects/dd5d8d17ff04496eb1bb7911bafbb289` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:37.834567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5d8d17ff04496eb1bb7911bafbb289)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:37.842089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:37.949416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 917/1859] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:37 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:37.957616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:37.962531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:37.969772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5d8d17ff04496eb1bb7911bafbb289', 'request_id': 'req-9df439de-4ab5-42dd-8499-033268d795cb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.978663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5d8d17ff04496eb1bb7911bafbb289', 'request_id': 'req-9df439de-4ab5-42dd-8499-033268d795cb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:37.988756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5d8d17ff04496eb1bb7911bafbb289', 'request_id': 'req-9df439de-4ab5-42dd-8499-033268d795cb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.023155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] The token cache is being invalidate because project dd5d8d17ff04496eb1bb7911bafbb289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:38.023655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.024529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.029678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 943/1860] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:37 2021] DELETE /identity/v3/projects/dd5d8d17ff04496eb1bb7911bafbb289 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:38.031621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:38.033621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.126212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2d60-b478-42e9-8f1c-d429c5af38d1 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:38.141507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df439de-4ab5-42dd-8499-033268d795cb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:38.165180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:38.167982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.168296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.169651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] PATH_INFO: `/v3/users/8d02692d972b43c3bb8210f7d3aee8db` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.172787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d02692d972b43c3bb8210f7d3aee8db)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:38.177401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:38.276395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:38.277066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.277349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.277626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.281144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.321381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d02692d972b43c3bb8210f7d3aee8db'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.321381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d02692d972b43c3bb8210f7d3aee8db'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.327926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d02692d972b43c3bb8210f7d3aee8db'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.351125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d02692d972b43c3bb8210f7d3aee8db'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.354933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d02692d972b43c3bb8210f7d3aee8db'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.382086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 944/1861] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:38 2021] DELETE /identity/v3/users/8d02692d972b43c3bb8210f7d3aee8db => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:38.423934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:38.425595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:38.463586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 918/1862] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:37 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:38.473424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:38.475229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.610212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bf3a-5b87-4895-a6b2-151b4630e23b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:38.618316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:38.619491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.619949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.620418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] PATH_INFO: `/v3/projects/576e7369b33f40abaf495f692bccf79e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.622228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=576e7369b33f40abaf495f692bccf79e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:38.625027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:38.662125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:38.664005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.678250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d975b-0a1e-4422-8a2c-732399b4e281 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:38.726201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576e7369b33f40abaf495f692bccf79e', 'request_id': 'req-8df01918-ac32-487e-ae2e-16968d318eae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.742713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576e7369b33f40abaf495f692bccf79e', 'request_id': 'req-8df01918-ac32-487e-ae2e-16968d318eae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.757056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576e7369b33f40abaf495f692bccf79e', 'request_id': 'req-8df01918-ac32-487e-ae2e-16968d318eae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.766113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:38.767674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.768025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.768551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.771777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.782217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] The token cache is being invalidate because project 576e7369b33f40abaf495f692bccf79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:38.782545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.783659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8df01918-ac32-487e-ae2e-16968d318eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:38.791739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 945/1863] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:38 2021] DELETE /identity/v3/projects/576e7369b33f40abaf495f692bccf79e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:38.793724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.794020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.794299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.829439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:38.830842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:38.848555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:38.850512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa1c2b-8981-4f90-b5e7-e7965e94e08d service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:38.876492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 919/1864] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:38 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:38.948614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 946/1865] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:38.955049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:38.955434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:38.955748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:38.983645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:38.991666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:39.014372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 920/1866] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:39.018969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.068356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84652b24-8965-4bd7-9310-0c55e8776fc4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.082012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.082901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.083332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.083823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.085393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:39.085715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.087915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.109298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 947/1867] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:39.112772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.123731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.127899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:39.133158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d856-36c5-4800-bec1-82968d1c0040 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.145177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.145871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.146156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.146438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.149002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.151165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.176252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223a71-b152-429f-a396-4cb6ad8659d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.190495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.191598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.191891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.192200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] PATH_INFO: `/v3/projects/a42c119710e341ce916f95ffff0313bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.193672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42c119710e341ce916f95ffff0313bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.197774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.229760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 921/1868] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:39 2021] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:39.234839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.360766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42c119710e341ce916f95ffff0313bc', 'request_id': 'req-d915f0c7-ad40-4a12-bd98-ea17f14053f3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:39.378581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42c119710e341ce916f95ffff0313bc', 'request_id': 'req-d915f0c7-ad40-4a12-bd98-ea17f14053f3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:39.394922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42c119710e341ce916f95ffff0313bc', 'request_id': 'req-d915f0c7-ad40-4a12-bd98-ea17f14053f3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:39.425842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4743a-6788-40ab-a8cf-79083a3a386b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.440332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] The token cache is being invalidate because project a42c119710e341ce916f95ffff0313bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:39.442440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:39.443476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d915f0c7-ad40-4a12-bd98-ea17f14053f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:39.448676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 948/1869] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:39 2021] DELETE /identity/v3/projects/a42c119710e341ce916f95ffff0313bc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:39.456245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e76c3-ecb2-4f73-a352-bce782bd86ae None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.456668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e76c3-ecb2-4f73-a352-bce782bd86ae None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.456946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e76c3-ecb2-4f73-a352-bce782bd86ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.519961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e43e76c3-ecb2-4f73-a352-bce782bd86ae None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:39.525467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e43e76c3-ecb2-4f73-a352-bce782bd86ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:39.544901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.545618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.546408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.546408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.546905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.548908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.619198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 922/1870] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:39 2021] POST /identity/v3/users => generated 297 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:39.624183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.626175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:39.660876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44eaf-f797-4312-9424-e362c1e09058 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.676979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.678001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.678468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.678928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.679892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.681946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.715227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 923/1871] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:39.716405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.739891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928480a-a2e3-49e8-a1c4-7ba031df7718 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.757582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.758307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.758609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.759300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.759725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.761459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.763717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 949/1872] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:39.772857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.773307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.773721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.779951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 924/1873] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:39.780938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.793465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c0f6-b24a-468e-b51f-8fa30858972d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.799275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:39.800233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.800828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.800828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] PATH_INFO: `/v3/projects/08ce0e672eec434384411a5eb1521517/users/fba46db3b72745439f52d15582b6918a/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.817920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:39.819768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:39.826861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ce0e672eec434384411a5eb1521517, user_id=fba46db3b72745439f52d15582b6918a, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:39.830108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78d1fa-14ec-4ee0-8466-679a79583ef5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:39.835898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 950/1874] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:39.841669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:39.857984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b76fa-eb66-4dc0-ae4c-8d2a8080ff54 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:39.869220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 925/1875] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:39 2021] PUT /identity/v3/projects/08ce0e672eec434384411a5eb1521517/users/fba46db3b72745439f52d15582b6918a/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:39.871001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb126-f724-4ecd-9aeb-1eb3e74822f2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:39.871304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb126-f724-4ecd-9aeb-1eb3e74822f2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:39.871584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05eb126-f724-4ecd-9aeb-1eb3e74822f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:39.912343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e05eb126-f724-4ecd-9aeb-1eb3e74822f2 None None] MFA Rules not processed for user `fba46db3b72745439f52d15582b6918a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:39.913978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e05eb126-f724-4ecd-9aeb-1eb3e74822f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:40.000902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.002686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.003180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.003727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.005024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:40.006441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.008561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f9821-7496-4d06-8e16-7f338cbbaa70 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.028926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 951/1876] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:40.030914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176b13-d59d-49a3-a7c6-51b798860db9 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.031628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176b13-d59d-49a3-a7c6-51b798860db9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.032116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176b13-d59d-49a3-a7c6-51b798860db9 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.041916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 952/1877] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:48:40 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:48:40.041916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176b13-d59d-49a3-a7c6-51b798860db9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.064609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176b13-d59d-49a3-a7c6-51b798860db9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.075587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.077720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.089708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 926/1878] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:40.089708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.089708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.089708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.096469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.098775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.100072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.103340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.133375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:40.134705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:40.199905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 953/1879] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:40.204864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.272475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 927/1880] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:40.279427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.295114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a3626-02bf-4a8d-832d-1e97a3eb7e6f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.396143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.396872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.397157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.397435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.401149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.403199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.447611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 928/1881] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:40.452320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.454212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:40.628127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086948b-88bf-4b48-9e65-3f418bb27f48 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.657058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.658049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.658756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.659275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.673437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.675623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.691539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 929/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:40.692852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.706078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e2c33-dee0-4c87-a074-47d1c88961e9 service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.712592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.713383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.713801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.714152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.715142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.716958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58c1d-a1a5-4743-8741-219d48ef9a64 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.737325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 930/1883] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:40.737325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.737325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.737325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.757735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] MFA Rules not processed for user `5010bab96b044f0d8d70c422ac1a5ade`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:40.759009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082d2b-0bcc-4bb1-acec-6d205a7315bf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.759250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:40.766286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.769569 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.770072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.771883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.772834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.776087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:40.838162 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 954/1884] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/projects => generated 393 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:40.839328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.857010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 931/1885] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:40.861184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:40.875668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a25ba-b6e4-4767-835c-296311aa4263 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.973957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcde663-9f85-4aeb-a72f-93cf2a46e7bd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:40.984927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:40.985980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:40.986878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:40.987429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:40.988430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:40.990933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.017856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 955/1886] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:41.021346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.036283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b164d-55ed-467a-ae2e-231f62161ff6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.049551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.050425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.050773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.051274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.052434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.052609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.054571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.054933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.055232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.055514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] PATH_INFO: `/v3/projects/a50b76b7f1784791baff5efb3b334b13/users/a1bf91648aad436da17fb97455fcbb22/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.080211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50b76b7f1784791baff5efb3b334b13, user_id=a1bf91648aad436da17fb97455fcbb22, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.084467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0995f-6cd7-4939-94c7-eb30ac36e5b4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.095670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 932/1887] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:40 2021] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:41.097341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.106856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 956/1888] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:41 2021] PUT /identity/v3/projects/a50b76b7f1784791baff5efb3b334b13/users/a1bf91648aad436da17fb97455fcbb22/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:41.123592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9ac3-4ddc-42bb-ad4b-dd79e9ee650f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.128412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.128886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.129911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.193692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] MFA Rules not processed for user `a1bf91648aad436da17fb97455fcbb22`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:41.195820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:41.222154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.222863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.223135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.223409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.224181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.225808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.246279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 933/1889] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:41.250702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.264754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66935-1a98-4a16-aa18-9a4c819f4d2a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.271447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.273122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.273688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.274177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] PATH_INFO: `/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd/users/15439dbf616f485b8d50bbd362e1af5d/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.296128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f9c2fbe9648a5b42c00f2d02114cd, user_id=15439dbf616f485b8d50bbd362e1af5d, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.299011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.333056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 957/1890] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:41 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:41.334601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 934/1891] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:41 2021] PUT /identity/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd/users/15439dbf616f485b8d50bbd362e1af5d/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:41.348253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.351050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.354031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:41.371652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b3b70-6371-4cfc-a8ec-59b2baae6bb4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.453757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636252-a937-4eea-88cc-60e7afeb87aa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.459611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.460745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.461149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.461506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.484866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.485804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.486093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.486372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.492027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.494659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.517288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 958/1892] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:41.522617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.538421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca381e-6060-4919-b583-542e48fcc58f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.544645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.545598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.546078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.547272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] PATH_INFO: `/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd/users/15439dbf616f485b8d50bbd362e1af5d/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.550849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1f9c2fbe9648a5b42c00f2d02114cd, user_id=15439dbf616f485b8d50bbd362e1af5d, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.554005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.556408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.557868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7356bcb-1862-4fd8-aac8-38716361a169 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.577058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 935/1893] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:41 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:41.608197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 959/1894] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:41 2021] PUT /identity/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd/users/15439dbf616f485b8d50bbd362e1af5d/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:41.614006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.614542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.614947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.644274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] MFA Rules not processed for user `15439dbf616f485b8d50bbd362e1af5d`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:41.645607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:41.736302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 936/1895] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:41 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:41.747023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:41.749745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:41.828409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcf6a-2118-4b05-98ce-5475fb08b05f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:41.832272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:41.832962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:41.833243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:41.833525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:41.856592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:41.859441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:41.875350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 960/1896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:41 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:41.987328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:42.017961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7f61d-e997-4553-866c-a3cbb2997ed0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:42.022619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:42.023829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:42.024409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:42.024917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:42.125115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:42.127935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0341d4-b1dc-449d-948e-77aa811aba0f service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:42.138858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 937/1897] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:41 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:42.750523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:42.752176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:42.826371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4680f49-cf9b-4999-8e6c-96ca35d7dc67 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:42.830889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:42.831763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:42.832050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:42.832429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] PATH_INFO: `/v3/users/6e310db744bc46deb32146c5e102301b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:42.833613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e310db744bc46deb32146c5e102301b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:42.835538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:42.887482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e310db744bc46deb32146c5e102301b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:42.888177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e310db744bc46deb32146c5e102301b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:42.899644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e310db744bc46deb32146c5e102301b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:42.909413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e310db744bc46deb32146c5e102301b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:42.910276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e310db744bc46deb32146c5e102301b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:42.928839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 961/1898] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:42 2021] DELETE /identity/v3/users/6e310db744bc46deb32146c5e102301b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:42.933825 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:42.934295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:42.934396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:42.952660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:42.953869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:43.015886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 938/1899] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:43.025907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:43.027382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:43.087923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55baa-3656-4bc0-bdb4-c4d03fade9c9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:43.091897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:43.092765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:43.096891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:43.096891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:43.107137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:43.110218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:43.128350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 962/1900] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:43.483943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:43.486887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:43.499535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b2849-7a5a-42ae-ac87-af2ba7020093 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:43.505259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:43.506429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:43.506855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:43.507300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] PATH_INFO: `/v3/projects/c2e8839b76e6484a87220f318fa72bb6` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:43.509125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e8839b76e6484a87220f318fa72bb6)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:43.511581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:43.563113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e8839b76e6484a87220f318fa72bb6', 'request_id': 'req-7f38e3c5-086d-41d6-ac42-1678da076ff3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.576491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e8839b76e6484a87220f318fa72bb6', 'request_id': 'req-7f38e3c5-086d-41d6-ac42-1678da076ff3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.588226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e8839b76e6484a87220f318fa72bb6', 'request_id': 'req-7f38e3c5-086d-41d6-ac42-1678da076ff3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.605122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] The token cache is being invalidate because project c2e8839b76e6484a87220f318fa72bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:43.605596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.606372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.608886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 939/1901] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:43 2021] DELETE /identity/v3/projects/c2e8839b76e6484a87220f318fa72bb6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:43.613155 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:43.623198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb20f8-a95b-46e8-8113-c277223a7920 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:43.702694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:43.703619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:43.703905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:43.704204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] PATH_INFO: `/v3/users/f869a04a483d4789b4878300c0d48db0` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:43.705772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f869a04a483d4789b4878300c0d48db0)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:43.707695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:43.764288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f869a04a483d4789b4878300c0d48db0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.764966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f869a04a483d4789b4878300c0d48db0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.776251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f869a04a483d4789b4878300c0d48db0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.784067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f869a04a483d4789b4878300c0d48db0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.784768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1426bc65-ed00-451d-a9dd-83724d55ec53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f869a04a483d4789b4878300c0d48db0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:43.796755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 963/1902] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:43 2021] DELETE /identity/v3/users/f869a04a483d4789b4878300c0d48db0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:44.077895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.079518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:44.093033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e3c5-086d-41d6-ac42-1678da076ff3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.153055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.153917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.154193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.154464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] PATH_INFO: `/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.155741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb80a7994b14cf0b2de6c5199d5409a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.157785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.343937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb80a7994b14cf0b2de6c5199d5409a', 'request_id': 'req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:44.350486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb80a7994b14cf0b2de6c5199d5409a', 'request_id': 'req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:44.356393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb80a7994b14cf0b2de6c5199d5409a', 'request_id': 'req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:44.372567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] The token cache is being invalidate because project 8eb80a7994b14cf0b2de6c5199d5409a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:44.372888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:44.373540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-83b51d8f-8c7c-4dc9-aa3f-992bdf1e9b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:44.375108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 940/1903] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:44 2021] DELETE /identity/v3/projects/8eb80a7994b14cf0b2de6c5199d5409a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:44.383193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.383710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.383821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.402317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:44.403527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:44.465201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 964/1904] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:44.473276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.473565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.473846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.492232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:44.493590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:44.501523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 941/1905] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:44.505914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.515983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939c33-2b05-4ec9-9cb3-7a7d8152a154 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.521715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.522459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.522739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.523114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.523762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:44.524112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.526002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.546580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.550351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 965/1906] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:48:44.555789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b65a4-cc9b-4cf6-9036-ae735570b843 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.561596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.562562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.562909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.563249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.564281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.566674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.611646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 942/1907] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:44.612965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.623624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08956e-86fc-4ead-90d0-3c958340b7ce admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.681102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.681815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.682106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.682381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.683134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.685092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.711725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 966/1908] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:44.713169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.730796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245ca26-00fa-450e-8ca8-20f9ef248b09 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.736097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.736941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.737248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.737858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.738886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.740843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.767476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 943/1909] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:44.771566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.781510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc866-a113-449b-9110-fb0786519138 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.786484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.787176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.787437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.787730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.788535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.790175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c3c79-cf4d-422c-b512-6dde90e99575 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.805083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 967/1910] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:44.805333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:44.815394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d550d-fec0-4e3c-b606-31f9bdbd404b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:44.820179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:44.821235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.821530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.821809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] PATH_INFO: `/v3/projects/47816194cc25492ca7d6b5650c8abe2c/users/15a4a075382141d8a08cffd9ea3d22e0/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.838818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47816194cc25492ca7d6b5650c8abe2c, user_id=15a4a075382141d8a08cffd9ea3d22e0, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:44.841630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:44.858342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 944/1911] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:44 2021] PUT /identity/v3/projects/47816194cc25492ca7d6b5650c8abe2c/users/15a4a075382141d8a08cffd9ea3d22e0/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:44.868906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf074-3536-4798-864e-0c076aa1482e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:44.869430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf074-3536-4798-864e-0c076aa1482e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:44.869716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf074-3536-4798-864e-0c076aa1482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:44.899924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-01baf074-3536-4798-864e-0c076aa1482e None None] MFA Rules not processed for user `15a4a075382141d8a08cffd9ea3d22e0`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:44.901633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-01baf074-3536-4798-864e-0c076aa1482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:44.973590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 968/1912] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:44.978514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.050808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435869ee-a50c-4458-b467-0c5ad335e999 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.056360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.057144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.057442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.057837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.058566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.060567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.091735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 945/1913] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:44 2021] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:45.092942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf074-3536-4798-864e-0c076aa1482e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.104746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf074-3536-4798-864e-0c076aa1482e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.166609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.167201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.167482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.167758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.168518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.170468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.192131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 969/1914] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:45 2021] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:45.196615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.207579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6035b-b57a-421f-a139-6e6d748a3401 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.213859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.214672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.215377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.215654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.216441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.218162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.229682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 946/1915] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:45.234759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.246193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309efd13-10cf-4255-a739-7c980f2f0cc4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.251524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.252470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.252755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.253031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] PATH_INFO: `/v3/projects/5e32132a37cd4150851dd5c71d66acd8/users/53723d7c7b3a4e10a5f2637aa8769982/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.270017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e32132a37cd4150851dd5c71d66acd8, user_id=53723d7c7b3a4e10a5f2637aa8769982, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.272952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.289525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 970/1916] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:45 2021] PUT /identity/v3/projects/5e32132a37cd4150851dd5c71d66acd8/users/53723d7c7b3a4e10a5f2637aa8769982/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:45.294808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.306628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ada62-ec5f-4bb9-802f-6975c0bca4ec admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.369926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.370629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.370908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.371185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.371956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.373578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06640b8e-205b-4527-848f-6008f760ed22 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.386987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 947/1917] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:45 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:45.388193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.398558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58294abd-d243-487d-a8cb-859eeb1c6590 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.403554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.404479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.404764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.405054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] PATH_INFO: `/v3/projects/5e32132a37cd4150851dd5c71d66acd8/users/53723d7c7b3a4e10a5f2637aa8769982/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.407110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e32132a37cd4150851dd5c71d66acd8, user_id=53723d7c7b3a4e10a5f2637aa8769982, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.409776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.419978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 971/1918] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:45 2021] PUT /identity/v3/projects/5e32132a37cd4150851dd5c71d66acd8/users/53723d7c7b3a4e10a5f2637aa8769982/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:45.431268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.431554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.431831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.458962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] MFA Rules not processed for user `53723d7c7b3a4e10a5f2637aa8769982`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:45.460226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:45.537658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 948/1919] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:45 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:45.556645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.558786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:45.634033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dd1a-d240-4032-93a5-51a2c25a6df9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.638109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.638775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.639351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.639807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.653049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.654500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.664311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 972/1920] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:45 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:45.764591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:45.774390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e99b35-5a0a-4527-8b79-f2d8c8703ac7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:45.778438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:45.779098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:45.779384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:45.779664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:45.836404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:45.837971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15911a-bc89-44b7-89a1-75369c3a960d service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:45.846890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 949/1921] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:45 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:46.843809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:46.845345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:46.932658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8162e1-14c9-4c41-a4b4-cfcb74dbab35 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:46.939382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:46.940645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:46.941145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:46.941733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] PATH_INFO: `/v3/users/a1bf91648aad436da17fb97455fcbb22` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:46.943664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1bf91648aad436da17fb97455fcbb22)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:46.946730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:47.023376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1bf91648aad436da17fb97455fcbb22'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:47.024701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1bf91648aad436da17fb97455fcbb22'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:47.054371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1bf91648aad436da17fb97455fcbb22'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:47.064001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1bf91648aad436da17fb97455fcbb22'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:47.065192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1bf91648aad436da17fb97455fcbb22'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:47.094029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 973/1922] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:46 2021] DELETE /identity/v3/users/a1bf91648aad436da17fb97455fcbb22 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:47.099236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:47.099756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:47.100439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:47.130253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:47.134397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:47.220596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 950/1923] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:47.231245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:47.233079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:47.303279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cb626-a22a-45cd-8b40-13e0c0dbf18f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:47.308933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:47.310835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:47.311261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:47.311539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:47.323282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:47.325649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f765979-b4fe-4fd8-952e-41078eb08a92 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:47.340544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 974/1924] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:48.412747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:48.418540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:48.435977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0019d5-ec0d-463b-a43b-e21c0b4eee9a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:48.441116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:48.442458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:48.442946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:48.443445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] PATH_INFO: `/v3/projects/a50b76b7f1784791baff5efb3b334b13` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:48.445652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50b76b7f1784791baff5efb3b334b13)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:48.447891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:48.539984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50b76b7f1784791baff5efb3b334b13', 'request_id': 'req-ac1e3fc1-cafb-416b-9c36-c3279f440214'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:48.555590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50b76b7f1784791baff5efb3b334b13', 'request_id': 'req-ac1e3fc1-cafb-416b-9c36-c3279f440214'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:48.562686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50b76b7f1784791baff5efb3b334b13', 'request_id': 'req-ac1e3fc1-cafb-416b-9c36-c3279f440214'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:48.596387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] The token cache is being invalidate because project a50b76b7f1784791baff5efb3b334b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:48.596387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:48.596993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ac1e3fc1-cafb-416b-9c36-c3279f440214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:48.604996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 951/1925] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:48 2021] DELETE /identity/v3/projects/a50b76b7f1784791baff5efb3b334b13 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:48.609367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:48.610392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:48.612740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:48.658726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:48.662111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:48.788804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 975/1926] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:48.797608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:48.797961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:48.798322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:48.824843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:48.827397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:48.850335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 952/1927] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:48.855686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:48.868205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4c4a4-2eed-4bfe-a220-fe9e5101ac92 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:48.874679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:48.875406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:48.875689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:48.875963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:48.876774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:48.877082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:48.878994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:48.901378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 976/1928] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:48.905345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:48.919906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0569d-756e-42b7-9389-462cf0510b8e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:48.925224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:48.926348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:48.927330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:48.927840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:48.928798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:48.931115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:48.966293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 953/1929] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:48 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:48.970778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:48.981711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fec09f-3ea9-46d6-a19a-cdcd60ab79d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.047107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.047855 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.048293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.048577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.049296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.051242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:49.074312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 977/1930] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:48 2021] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:49.078718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:49.090104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d538-0b06-4817-852c-b38fa2124924 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.095853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.096680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.096826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.097105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.097864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.099881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:49.113619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 954/1931] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:49 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:49.118993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:49.135972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7593d2-214b-4e26-bf45-f33a1b493771 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.142154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.144891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.145202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.145481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.146251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.147846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f70039-568b-4547-8cbb-741a45a83951 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:49.162765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 978/1932] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:49 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:49.167322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:49.177651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30317dc-52b1-47f8-972d-4879c3645c3b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.182444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.183325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.183604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.183901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] PATH_INFO: `/v3/projects/9c0f2a4bac6a48bfa43491b3b977b15f/users/11935130e64147e08ffe773859c459cd/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.201813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0f2a4bac6a48bfa43491b3b977b15f, user_id=11935130e64147e08ffe773859c459cd, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.205145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:49.227441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 955/1933] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:49 2021] PUT /identity/v3/projects/9c0f2a4bac6a48bfa43491b3b977b15f/users/11935130e64147e08ffe773859c459cd/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:49.238009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.238306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.238700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.280716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] MFA Rules not processed for user `11935130e64147e08ffe773859c459cd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:49.282333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:49.397499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 979/1934] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:49 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:49.410710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:49.415317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:49.515477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c223e9-9c06-4fd6-8b26-6b8cc79823e5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.520168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.521224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.521611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.522034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.548333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.551232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4ba51-c823-4448-b8ae-8781945ea5b4 service glance] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:49.571415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 956/1935] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:49 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:49.864143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:49.865756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:49.975298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7bdc6-fdc3-497f-b5ef-f61f8c12c8c0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:49.981035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:49.982949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:49.983503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:49.984051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] PATH_INFO: `/v3/users/15a4a075382141d8a08cffd9ea3d22e0` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:49.985819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a4a075382141d8a08cffd9ea3d22e0)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:49.988477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:50.057217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a4a075382141d8a08cffd9ea3d22e0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.057983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a4a075382141d8a08cffd9ea3d22e0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.075518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a4a075382141d8a08cffd9ea3d22e0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.084843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a4a075382141d8a08cffd9ea3d22e0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.085542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a4a075382141d8a08cffd9ea3d22e0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.104217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 980/1936] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:49 2021] DELETE /identity/v3/users/15a4a075382141d8a08cffd9ea3d22e0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:50.106328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:50.106758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:50.107161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:50.147488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:50.152686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.182115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:50.184281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.320112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 957/1937] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:50.331724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:50.332294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebdc7-9313-4e5b-b407-f3f5cd1deeeb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:50.333566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.352492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:50.353648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:50.354160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:50.354805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] PATH_INFO: `/v3/users/fba46db3b72745439f52d15582b6918a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:50.356689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba46db3b72745439f52d15582b6918a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:50.360107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:50.444494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba46db3b72745439f52d15582b6918a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.446321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba46db3b72745439f52d15582b6918a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.473115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b00b-3852-495b-b413-24fd05e98b15 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:50.491855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:50.492591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:50.492994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:50.493334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:50.501332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba46db3b72745439f52d15582b6918a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.501649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.517025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba46db3b72745439f52d15582b6918a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.517984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba46db3b72745439f52d15582b6918a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:50.538582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:50.541165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc8de-b3fb-4030-8b1b-8bfec60c53f5 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:50.562166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 958/1938] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:48:50.570841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 981/1939] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:50 2021] DELETE /identity/v3/users/fba46db3b72745439f52d15582b6918a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:50.586857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:50.592082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:50.594553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:50.635692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:50.637201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.751987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 959/1940] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:50.773678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:50.776199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:50.886373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04d78a-1371-4edd-b496-51c5e3b59f3d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:50.906731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:50.907695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:50.908061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:50.908386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:50.926893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:50.928229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:50.950062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 982/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:51.274165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:51.276669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:51.332629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd118b-d6e0-47f3-b787-470c7d80e53a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:51.342019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:51.343059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:51.343513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:51.343926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] PATH_INFO: `/v3/projects/08ce0e672eec434384411a5eb1521517` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:51.348761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ce0e672eec434384411a5eb1521517)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:51.351060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:51.414062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ce0e672eec434384411a5eb1521517', 'request_id': 'req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.420895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ce0e672eec434384411a5eb1521517', 'request_id': 'req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.427565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ce0e672eec434384411a5eb1521517', 'request_id': 'req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.442569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] The token cache is being invalidate because project 08ce0e672eec434384411a5eb1521517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:51.442861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.443510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.445113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 960/1942] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:51 2021] DELETE /identity/v3/projects/08ce0e672eec434384411a5eb1521517 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:51.449500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:51.460524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60cb81-c149-46cb-88da-c7777b458f55 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:51.491290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:51.493236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:51.553150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:51.554135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:51.554488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:51.554834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] PATH_INFO: `/v3/users/15439dbf616f485b8d50bbd362e1af5d` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:51.556408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15439dbf616f485b8d50bbd362e1af5d)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:51.558439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:51.596890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c34d7-0ec1-43ea-b8d5-edb3a255ba95 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:51.606372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:51.607870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:51.608175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:51.608466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] PATH_INFO: `/v3/projects/47816194cc25492ca7d6b5650c8abe2c` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:51.609722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47816194cc25492ca7d6b5650c8abe2c)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:51.611688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:51.616871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15439dbf616f485b8d50bbd362e1af5d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.617534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15439dbf616f485b8d50bbd362e1af5d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.630524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15439dbf616f485b8d50bbd362e1af5d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.639961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15439dbf616f485b8d50bbd362e1af5d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.640887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15439dbf616f485b8d50bbd362e1af5d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.663874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 983/1943] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:51 2021] DELETE /identity/v3/users/15439dbf616f485b8d50bbd362e1af5d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:51.677892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47816194cc25492ca7d6b5650c8abe2c', 'request_id': 'req-7a92fb95-4700-42cc-921d-f8d530cbe62e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.685568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47816194cc25492ca7d6b5650c8abe2c', 'request_id': 'req-7a92fb95-4700-42cc-921d-f8d530cbe62e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.692549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47816194cc25492ca7d6b5650c8abe2c', 'request_id': 'req-7a92fb95-4700-42cc-921d-f8d530cbe62e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.727167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] The token cache is being invalidate because project 47816194cc25492ca7d6b5650c8abe2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:51.727590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.732914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.736187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 961/1944] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:51 2021] DELETE /identity/v3/projects/47816194cc25492ca7d6b5650c8abe2c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:51.741083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:51.743080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:51.836339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4ba80-5109-40ab-98b0-8c0ffba3d7d7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:51.845217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:51.846878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:51.847436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:51.848338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] PATH_INFO: `/v3/users/53723d7c7b3a4e10a5f2637aa8769982` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:51.850964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53723d7c7b3a4e10a5f2637aa8769982)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:51.854580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:51.923530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53723d7c7b3a4e10a5f2637aa8769982'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.924765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53723d7c7b3a4e10a5f2637aa8769982'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.944671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53723d7c7b3a4e10a5f2637aa8769982'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.958191 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53723d7c7b3a4e10a5f2637aa8769982'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.958912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-aff5350c-5f58-41fa-b87e-3be4a2e39edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53723d7c7b3a4e10a5f2637aa8769982'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:51.990255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 984/1945] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:51 2021] DELETE /identity/v3/users/53723d7c7b3a4e10a5f2637aa8769982 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:52.163209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:52.165149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.287867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fb95-4700-42cc-921d-f8d530cbe62e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:52.405641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:52.406890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.408367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.408814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] PATH_INFO: `/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.410820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1f9c2fbe9648a5b42c00f2d02114cd)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:52.418028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:52.521161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1f9c2fbe9648a5b42c00f2d02114cd', 'request_id': 'req-f5d790b1-6acd-4ea9-a919-47c90b9593e2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.545599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1f9c2fbe9648a5b42c00f2d02114cd', 'request_id': 'req-f5d790b1-6acd-4ea9-a919-47c90b9593e2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.553249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1f9c2fbe9648a5b42c00f2d02114cd', 'request_id': 'req-f5d790b1-6acd-4ea9-a919-47c90b9593e2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.586252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] The token cache is being invalidate because project 6a1f9c2fbe9648a5b42c00f2d02114cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:52.589079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.589900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.592105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 962/1946] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:52 2021] DELETE /identity/v3/projects/6a1f9c2fbe9648a5b42c00f2d02114cd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:52.602824 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c8a9-f017-40ad-b811-2358078cc4e3 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.603104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c8a9-f017-40ad-b811-2358078cc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.603389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c8a9-f017-40ad-b811-2358078cc4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.628196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d9f3c8a9-f017-40ad-b811-2358078cc4e3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:52.629434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d9f3c8a9-f017-40ad-b811-2358078cc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.678246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:52.680840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.758652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 985/1947] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:52.760839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.761135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.761459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.787069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:52.788431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.803800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 986/1948] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:52.806433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:52.808914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d790b1-6acd-4ea9-a919-47c90b9593e2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:52.815712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:52.816778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.817164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.817281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20b887-f40e-410d-8055-8c8bf46ac246 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:52.817613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] PATH_INFO: `/v3/projects/5e32132a37cd4150851dd5c71d66acd8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.819633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e32132a37cd4150851dd5c71d66acd8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:52.822102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:52.822390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:52.823260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.823568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.824113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.825111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:52.825416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:52.827456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:52.843391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 987/1949] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:52.847950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:52.865286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffabcb-0ad5-45fc-9e24-ce718d90a422 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:52.884925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e32132a37cd4150851dd5c71d66acd8', 'request_id': 'req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.895089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e32132a37cd4150851dd5c71d66acd8', 'request_id': 'req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.900730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e32132a37cd4150851dd5c71d66acd8', 'request_id': 'req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.915462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] The token cache is being invalidate because project 5e32132a37cd4150851dd5c71d66acd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:52.915753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.916437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9c3686ee-2aba-4e77-a3f6-d1cacc383dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:52.917981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 963/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:52 2021] DELETE /identity/v3/projects/5e32132a37cd4150851dd5c71d66acd8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:52.923711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b655-6e60-4738-b452-23e2f1ec1171 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.923997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b655-6e60-4738-b452-23e2f1ec1171 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.924333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027b655-6e60-4738-b452-23e2f1ec1171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.926165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:52.926986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.927385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.927663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.928411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:52.930332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:52.947319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e027b655-6e60-4738-b452-23e2f1ec1171 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:52.949119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e027b655-6e60-4738-b452-23e2f1ec1171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.958480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 988/1951] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:52.959262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 964/1952] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:52.963036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:52.964946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:52.967950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:52.968292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:52.968571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:52.987334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:52.988589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:53.031033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e41e5-2159-4a67-9552-21bd9de540ef admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.037785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.038495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.038784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.039061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.040015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.042152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.048282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 965/1953] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:53.053028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.062889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9996b8-3cf4-4ab6-bbac-10f0bf3ff3ed None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.067671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 989/1954] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:52 2021] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:53.067963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.068290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.068573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.068850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.068968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.069599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:53.069904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.071628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.078622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f94e3b-9ff9-40dc-a4aa-425dd506ef25 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.083643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 966/1955] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:48:53.084454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.085143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.085426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.085698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.086437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.088046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.088454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.097607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d463b5-336a-403e-a75e-10f529ccb781 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.098588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 990/1956] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.102438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.102601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.103252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.103540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.103815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.104547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.106475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.112286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf482b-ef3d-4d17-9bc2-8b5132f48ddb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.116902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.117547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.117892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.118164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.119034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.120699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.132112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 991/1957] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:53.136466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.140043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 967/1958] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:53.140821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.147119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a168-c4bc-41ef-9c19-a61c98c1626c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.199235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18869a-2903-491f-9d45-ab75def3ef7c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.200908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.201799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.202079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.202352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] PATH_INFO: `/v3/projects/c3515c502d884494b6febe19eb2d3926/users/845e4ae45a0e405c98b80029afac8e9c/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.204126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.205007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.205440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.205773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.206610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.210801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.219393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3515c502d884494b6febe19eb2d3926, user_id=845e4ae45a0e405c98b80029afac8e9c, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.222335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad223-e7be-451f-99ff-0472520e31cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.236865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 968/1959] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:53.238193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 992/1960] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:53 2021] PUT /identity/v3/projects/c3515c502d884494b6febe19eb2d3926/users/845e4ae45a0e405c98b80029afac8e9c/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:53.240964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.251300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120463-0942-411e-bf57-cd933195f746 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.257591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.258094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.259454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.291817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] MFA Rules not processed for user `845e4ae45a0e405c98b80029afac8e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:53.293623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:53.329519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.330521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.330976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.331402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.332348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.334114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.349225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 969/1961] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.350589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.361091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947721e-ab10-4ea1-a2a6-8015a2aac25b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.366759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.367431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.367751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.368098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.368911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.370513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.372371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 993/1962] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:53.379319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.386181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 970/1963] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.390153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.390876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca98b2-a783-4a80-9a9d-a1ae76855859 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.395534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.396230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.396516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.396820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.397534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.399584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.402051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f547dbb-4846-4bb5-826e-c0304ce28fb0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.410303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.411206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.411483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.411759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] PATH_INFO: `/v3/projects/8a5b438bad764196a805defa24111baa/users/8044b647ef1f4b99af3bc2f639c32a56/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.430891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5b438bad764196a805defa24111baa, user_id=8044b647ef1f4b99af3bc2f639c32a56, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.433918 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f888f8-bc4f-4692-ae68-11197a937b07 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.444184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 994/1964] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:53.446219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.452888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 971/1965] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:53 2021] PUT /identity/v3/projects/8a5b438bad764196a805defa24111baa/users/8044b647ef1f4b99af3bc2f639c32a56/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:53.463471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.463763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.464050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.494195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] MFA Rules not processed for user `8044b647ef1f4b99af3bc2f639c32a56`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:53.496387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:53.515084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107083a-a207-4e74-92bf-97764c246af9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.575811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 972/1966] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:53.580604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.585683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.586700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.588518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.589228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.590910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.593450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.622918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 995/1967] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:53.624340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.635629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811976-3d53-40db-b878-ceb3ad8dbf18 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.640887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.641602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.641959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.642304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.643124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.644822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.655004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 996/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.659172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.661284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a619-ff32-4021-8e76-8badd8089cd7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.666900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.667607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.667892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.668192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.669039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.670448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671ffb7-6a09-4e60-bf8d-2af8a8267d79 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.670969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.676253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.677204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.677533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.677809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] PATH_INFO: `/v3/projects/aa906346014f4dbcb8c667eed92c630f/users/a01986086f65485fac85205e954495fc/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.695443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa906346014f4dbcb8c667eed92c630f, user_id=a01986086f65485fac85205e954495fc, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.698479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.704497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 973/1969] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:53.709253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.714015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 997/1970] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:53 2021] PUT /identity/v3/projects/aa906346014f4dbcb8c667eed92c630f/users/a01986086f65485fac85205e954495fc/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:53.718279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.790742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd1ae0-628e-47dd-8d03-b0745c7c5c9c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.796043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.796991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.797413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.797835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.798714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.799102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d6a30-5b61-4619-a1ef-db57cf159669 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.801031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.817423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.818530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.818721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.818994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.819825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.822109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.837002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 974/1971] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:53.839528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 998/1972] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.840604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.840714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.854946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c58b98-9ad5-403e-8968-ec1422e9fc83 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.858118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c0816-43c9-4e10-90c5-af01b54c1cdc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.866307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.867597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.868065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.868859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] PATH_INFO: `/v3/projects/aa906346014f4dbcb8c667eed92c630f/users/a01986086f65485fac85205e954495fc/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.877329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa906346014f4dbcb8c667eed92c630f, user_id=a01986086f65485fac85205e954495fc, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.878780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:53.879419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.879699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.880319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.885178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:53.885178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.898886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304ebf8-10f5-4456-871b-146715eee254 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:53.907033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 999/1973] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:53.912617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:53.933167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 975/1974] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:53 2021] PUT /identity/v3/projects/aa906346014f4dbcb8c667eed92c630f/users/a01986086f65485fac85205e954495fc/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:53.936043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:53.936503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:53.936792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:53.940622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f7-7df2-4b30-90ca-47c6d90a4f4d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:53.996419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] MFA Rules not processed for user `a01986086f65485fac85205e954495fc`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:53.998761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:54.029767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.030933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.031247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.031520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] PATH_INFO: `/v3/projects/b21217d6c01842d59819292571f9b9ae/users/64dc9d8acbb741d3b03f97765dd4cd19/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.046277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21217d6c01842d59819292571f9b9ae, user_id=64dc9d8acbb741d3b03f97765dd4cd19, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.048941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.062804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1000/1975] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:53 2021] PUT /identity/v3/projects/b21217d6c01842d59819292571f9b9ae/users/64dc9d8acbb741d3b03f97765dd4cd19/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:54.067082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.076017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 976/1976] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:53 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:54.086767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.088260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:54.136412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68738a6f-73b8-4771-b98f-7e2cbc9cdd59 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.142330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.143014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.143165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebdf3-2154-4986-9781-c88b8e70457a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.143283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.143557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.144366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.145983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.156205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1001/1977] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:54 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:54.160307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.169656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442721-6a14-4085-99e2-f7f1ff6fcadc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.174453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.175357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.175649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.175927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] PATH_INFO: `/v3/projects/b21217d6c01842d59819292571f9b9ae/users/64dc9d8acbb741d3b03f97765dd4cd19/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.178103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21217d6c01842d59819292571f9b9ae, user_id=64dc9d8acbb741d3b03f97765dd4cd19, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.181061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1958f4c-67a0-4069-b1eb-8fe8b1f84731 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.188907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.189555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.189839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.190121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.192799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1002/1978] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:54 2021] PUT /identity/v3/projects/b21217d6c01842d59819292571f9b9ae/users/64dc9d8acbb741d3b03f97765dd4cd19/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:48:54.203883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.204207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.204494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.231960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] MFA Rules not processed for user `64dc9d8acbb741d3b03f97765dd4cd19`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:54.233531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:54.251205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.252747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.265336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 977/1979] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:54 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:54.304518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1003/1980] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:54 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:54.315891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.317667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:54.329850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042feb0-0f76-4aa9-af3b-adc2988ce9aa service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.382294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.382958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.383238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.383632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.393253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.394672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.404114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 978/1981] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:54 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:54.492614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.503488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32664f32-1603-4d28-b705-fcd69bba2f83 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.507199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.507852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.508128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.508586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.574807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.576480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad4eb0-0c4d-4e35-b579-cf700272f174 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:54.588220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1004/1982] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:54 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:54.884115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:54.953544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15207b-c7a2-417b-9435-1434e7990add service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:54.958045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:54.958920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:54.959203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:54.959471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] PATH_INFO: `/v3/users/8044b647ef1f4b99af3bc2f639c32a56` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:54.960697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8044b647ef1f4b99af3bc2f639c32a56)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:54.962682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:55.016279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8044b647ef1f4b99af3bc2f639c32a56'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.017511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8044b647ef1f4b99af3bc2f639c32a56'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.030978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8044b647ef1f4b99af3bc2f639c32a56'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.038009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8044b647ef1f4b99af3bc2f639c32a56'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.047053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8044b647ef1f4b99af3bc2f639c32a56'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.053481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 979/1983] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:54 2021] DELETE /identity/v3/users/8044b647ef1f4b99af3bc2f639c32a56 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:55.058682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:55.059144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:55.061472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:55.083979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:55.085288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:55.154669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1005/1984] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:55.165676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:55.168132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:55.234925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78c6f-84e8-41e0-9d6b-2cec632030b2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:55.238622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:55.239279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:55.239559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:55.239829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:55.248802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:55.250239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:55.260283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 980/1985] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:55.561621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:55.563244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:55.580867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57cde3-afcf-4f58-9a9e-3dfd4e5b3289 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:55.586967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:55.587904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:55.588374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:55.588653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] PATH_INFO: `/v3/projects/8a5b438bad764196a805defa24111baa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:55.590163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5b438bad764196a805defa24111baa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:55.592139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:55.643869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5b438bad764196a805defa24111baa', 'request_id': 'req-3f54218d-f739-4917-a1b0-baf09e4c8494'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.650093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5b438bad764196a805defa24111baa', 'request_id': 'req-3f54218d-f739-4917-a1b0-baf09e4c8494'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.655482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5b438bad764196a805defa24111baa', 'request_id': 'req-3f54218d-f739-4917-a1b0-baf09e4c8494'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.676908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] The token cache is being invalidate because project 8a5b438bad764196a805defa24111baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:55.677206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.677962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.679974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1006/1986] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:55 2021] DELETE /identity/v3/projects/8a5b438bad764196a805defa24111baa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:55.685414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:55.707061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518f146-1bb3-4753-8be4-33503a975401 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:55.798732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:55.800216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:55.800643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:55.801083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] PATH_INFO: `/v3/users/64dc9d8acbb741d3b03f97765dd4cd19` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:55.802531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dc9d8acbb741d3b03f97765dd4cd19)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:55.804615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:55.865998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dc9d8acbb741d3b03f97765dd4cd19'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.867238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dc9d8acbb741d3b03f97765dd4cd19'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.882772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dc9d8acbb741d3b03f97765dd4cd19'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.889950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dc9d8acbb741d3b03f97765dd4cd19'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.898706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-71d486f6-553e-473a-95a0-0d03e2fdab1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dc9d8acbb741d3b03f97765dd4cd19'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:55.905948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 981/1987] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:48:55 2021] DELETE /identity/v3/users/64dc9d8acbb741d3b03f97765dd4cd19 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:56.222407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.223957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:56.248057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54218d-f739-4917-a1b0-baf09e4c8494 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.324679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.325680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.325965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.326255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] PATH_INFO: `/v3/projects/b21217d6c01842d59819292571f9b9ae` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.327792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21217d6c01842d59819292571f9b9ae)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.329791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.392041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21217d6c01842d59819292571f9b9ae', 'request_id': 'req-26aac7f3-99dd-427a-974d-ec45561e4230'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:56.398489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21217d6c01842d59819292571f9b9ae', 'request_id': 'req-26aac7f3-99dd-427a-974d-ec45561e4230'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:56.404183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21217d6c01842d59819292571f9b9ae', 'request_id': 'req-26aac7f3-99dd-427a-974d-ec45561e4230'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:56.418825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] The token cache is being invalidate because project b21217d6c01842d59819292571f9b9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:48:56.419121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:56.419768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-26aac7f3-99dd-427a-974d-ec45561e4230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:48:56.421378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1007/1988] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:48:56 2021] DELETE /identity/v3/projects/b21217d6c01842d59819292571f9b9ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:56.427201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d269-380b-4be1-9024-f71173f916ae None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.427496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d269-380b-4be1-9024-f71173f916ae None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.427775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d269-380b-4be1-9024-f71173f916ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.449619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4446d269-380b-4be1-9024-f71173f916ae None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:56.450844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4446d269-380b-4be1-9024-f71173f916ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:56.509519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 982/1989] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:48:56.517794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.518049 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.518317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.540387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:56.541725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:56.550291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1008/1990] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:56.555050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446d269-380b-4be1-9024-f71173f916ae None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.564808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446d269-380b-4be1-9024-f71173f916ae None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.570184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.570957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.571346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.571623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.572434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:48:56.572740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.574353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.586238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 983/1991] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:48:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:48:56.590888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.600291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f012aaf-1046-4b53-8e3c-b9b7090c0dd0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.605899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.606565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.606844 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.607445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.608181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.610101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.637541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1009/1992] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:56 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:56.643644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.654596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfdf25-faef-45ef-8103-a8060df6644b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.714877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.715599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.715883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.716176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.716929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.718923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.741026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 984/1993] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:56 2021] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:56.745490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.760470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab02c0-f038-46bb-9b62-7c12a679cc45 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.765658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.766385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.766702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.766977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.767746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.769548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.780696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1010/1994] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:48:56.785071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.795373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf864-f19f-43d3-a76a-9943adadf95b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.800404 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.801084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.801371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.801645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.802388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.804012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f32da-702d-4960-9937-b73352363f0e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.814208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 985/1995] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:56.818495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.829472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6502cb-ffc5-42b8-aadb-f6b8a19df879 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:56.834729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:56.835654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.835949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.836273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] PATH_INFO: `/v3/projects/008b0d7eb46645bdabe9ee0c4c7652c0/users/1949e4e7d2e74a539bf739591e89d2b9/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.853028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=008b0d7eb46645bdabe9ee0c4c7652c0, user_id=1949e4e7d2e74a539bf739591e89d2b9, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:56.855739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:56.871096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1011/1996] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:56 2021] PUT /identity/v3/projects/008b0d7eb46645bdabe9ee0c4c7652c0/users/1949e4e7d2e74a539bf739591e89d2b9/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:56.876623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73440-2dfa-4ba5-b58d-bb9ab201b171 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:56.876979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73440-2dfa-4ba5-b58d-bb9ab201b171 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:56.877197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73440-2dfa-4ba5-b58d-bb9ab201b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:56.899869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-0fc73440-2dfa-4ba5-b58d-bb9ab201b171 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:56.901241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0fc73440-2dfa-4ba5-b58d-bb9ab201b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:56.963073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 986/1997] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:56.973231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:56.975026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:57.042637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1383b-f1a7-48fe-9904-b81ffea74e0b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:57.046332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:57.047009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:57.047293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:57.047569 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:57.056730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:57.058160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:57.067799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1012/1998] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:57.876557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:57.876856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:57.877415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:57.907964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] MFA Rules not processed for user `1949e4e7d2e74a539bf739591e89d2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:57.909204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:57.991382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 987/1999] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:57 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:57.996219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.008776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312585-3ffa-4170-a89f-61b54f838a35 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.015040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.016005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.016415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.016752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.017495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.020605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.063131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1013/2000] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:48:57 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:48:58.067741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.082152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749662-3274-48d2-91e2-be3079b4d25f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.183886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.184605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.185075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.185337 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.186062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.188004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.210083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 988/2001] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:48:58 2021] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:48:58.213780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.241196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68040f-3290-4b35-997b-0b209a5889ae admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.248372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.249581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.249581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.250032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.250734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.252745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.267825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1014/2002] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:58.272182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.282214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5c396-8404-4a76-95e2-fb146ada7669 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.287715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.288705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.288990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.289207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] PATH_INFO: `/v3/projects/87702e6a0cb2446698353cb27a4d4683/users/e7411047fb1d481eab57b4dc5f1459c4/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.306572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87702e6a0cb2446698353cb27a4d4683, user_id=e7411047fb1d481eab57b4dc5f1459c4, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.309378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.324300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 989/2003] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:58 2021] PUT /identity/v3/projects/87702e6a0cb2446698353cb27a4d4683/users/e7411047fb1d481eab57b4dc5f1459c4/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:58.328366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.338276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56212d-12d0-4477-ac8e-dbe9a44f2ded admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.396935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.397954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.398383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.398815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.400485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.402916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.418320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1015/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:48:58.422821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.434204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305411-4b72-4cb4-ac53-4c19d82bc42e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.439782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.440718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.441002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.441303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] PATH_INFO: `/v3/projects/87702e6a0cb2446698353cb27a4d4683/users/e7411047fb1d481eab57b4dc5f1459c4/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.443450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87702e6a0cb2446698353cb27a4d4683, user_id=e7411047fb1d481eab57b4dc5f1459c4, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:58.446309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc039b7-1c3c-4931-b4e2-8d03b3e43e67 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:58.456199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 990/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:48:58 2021] PUT /identity/v3/projects/87702e6a0cb2446698353cb27a4d4683/users/e7411047fb1d481eab57b4dc5f1459c4/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:48:58.675919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:58.677981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:58.767843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e690c3-11d3-4592-a96c-3c5572eda612 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:58.895193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:58.895877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:58.896184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:58.905386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:58.908352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:59.017582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:59.019098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:59.031487 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1016/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:58 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:48:59.212556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8801-4ba2-409d-994c-421b607910fa None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:59.213066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8801-4ba2-409d-994c-421b607910fa None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:59.213224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8801-4ba2-409d-994c-421b607910fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:59.242036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fc2b8801-4ba2-409d-994c-421b607910fa None None] MFA Rules not processed for user `e7411047fb1d481eab57b4dc5f1459c4`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:48:59.243290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fc2b8801-4ba2-409d-994c-421b607910fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:48:59.332454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 991/2007] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:48:59 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:48:59.570966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:48:59.583579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b623-f070-49e3-8469-4674817b9b39 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:48:59.588788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:48:59.590311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:48:59.601981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:48:59.602494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:48:59.668966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:48:59.671576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:48:59.680946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1017/2008] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:48:59 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:00.072399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:00.072957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:00.073432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:00.097695 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] MFA Rules not processed for user `9afb7b5b35cb487ba063c7ee7fbcd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:00.099207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:00.187144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 992/2009] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:01.138918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:01.154277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf867ad-dce1-4808-98aa-097edf061890 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:01.158095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:01.158945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:01.159435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:01.159945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:01.173618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:01.175435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b1eee-d015-4ae0-986f-81521cd6785e service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:01.188954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1018/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:01 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:11.622136 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:11.623800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:11.697166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8146-751f-405b-8b3f-a87c7e20930b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:11.702542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:11.703591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:11.703900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:11.704215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] PATH_INFO: `/v3/users/845e4ae45a0e405c98b80029afac8e9c` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:11.705575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=845e4ae45a0e405c98b80029afac8e9c)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:11.707739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:11.764993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845e4ae45a0e405c98b80029afac8e9c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:11.765836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845e4ae45a0e405c98b80029afac8e9c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:11.777960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845e4ae45a0e405c98b80029afac8e9c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:11.785245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845e4ae45a0e405c98b80029afac8e9c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:11.798783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845e4ae45a0e405c98b80029afac8e9c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:11.805575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 993/2011] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:11 2021] DELETE /identity/v3/users/845e4ae45a0e405c98b80029afac8e9c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:11.810307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:11.811207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:11.813034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:11.832868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:11.834249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:11.893794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1019/2012] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:11.904477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:11.906161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:11.968374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aabb1-269f-4866-9fa9-a6d696f3f52a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:11.973244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:11.973953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:11.974230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:11.974497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:11.985168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:11.986636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:11.996585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 994/2013] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:12.285435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:12.287171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:12.300395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed8c1-d7b1-497a-9854-042d74fd4ce5 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:12.305061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:12.305912 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:12.306192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:12.306463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] PATH_INFO: `/v3/projects/c3515c502d884494b6febe19eb2d3926` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:12.307675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3515c502d884494b6febe19eb2d3926)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:12.309966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:12.362626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3515c502d884494b6febe19eb2d3926', 'request_id': 'req-28615b2d-bcff-4eff-a0be-3e39b31f0fae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.369084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3515c502d884494b6febe19eb2d3926', 'request_id': 'req-28615b2d-bcff-4eff-a0be-3e39b31f0fae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.375384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3515c502d884494b6febe19eb2d3926', 'request_id': 'req-28615b2d-bcff-4eff-a0be-3e39b31f0fae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.392260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] The token cache is being invalidate because project c3515c502d884494b6febe19eb2d3926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:12.392559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.393196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.394864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1020/2014] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:12 2021] DELETE /identity/v3/projects/c3515c502d884494b6febe19eb2d3926 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:12.399273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:12.414508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5496c89-815d-4b10-82c7-f76dad8bdffa service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:12.475244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:12.476409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:12.477208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:12.477208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] PATH_INFO: `/v3/users/a01986086f65485fac85205e954495fc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:12.478666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01986086f65485fac85205e954495fc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:12.481406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:12.563561 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01986086f65485fac85205e954495fc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.564309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01986086f65485fac85205e954495fc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.580054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01986086f65485fac85205e954495fc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.587084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01986086f65485fac85205e954495fc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.597275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-a13d8e9f-88ad-43fa-ae71-a55afa54bd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01986086f65485fac85205e954495fc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:12.607080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 995/2015] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:12 2021] DELETE /identity/v3/users/a01986086f65485fac85205e954495fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:13.041183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.042800 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:13.059962 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28615b2d-bcff-4eff-a0be-3e39b31f0fae admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.135206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.136036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.136369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.136647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] PATH_INFO: `/v3/projects/aa906346014f4dbcb8c667eed92c630f` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.137920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa906346014f4dbcb8c667eed92c630f)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.139867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.187807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa906346014f4dbcb8c667eed92c630f', 'request_id': 'req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:13.193918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa906346014f4dbcb8c667eed92c630f', 'request_id': 'req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:13.199801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa906346014f4dbcb8c667eed92c630f', 'request_id': 'req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:13.214221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] The token cache is being invalidate because project aa906346014f4dbcb8c667eed92c630f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:13.214520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:13.215181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2fb85a34-9e44-4bdf-8b60-2b78f5aaddfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:13.216810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1021/2016] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:13 2021] DELETE /identity/v3/projects/aa906346014f4dbcb8c667eed92c630f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:13.224384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.224876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.224982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.244853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:13.246336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:13.308872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 996/2017] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:13.317234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.317538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.317874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.336926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:13.338580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:13.347607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1022/2018] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:13.352180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.362887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b7e6f-2d1f-42bb-816a-358cc8f8bd22 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.368601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.369393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.369680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.369952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.370731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:13.371126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.372793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.384812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 997/2019] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:49:13.389597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.399320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe5ed-e74a-4b84-ad2a-d4970a70d596 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.405295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.405950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.406255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.406515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.407244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.409247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.441296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1023/2020] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:13.442900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.455761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2594f8-1f5b-480b-a012-258b3f6b144a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.517079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.517774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.518059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.518335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.519051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.521057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.540863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 998/2021] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:13.545514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.556501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160b80-7665-4d9a-93ea-9939ef64fe24 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.561543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.562346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.562630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.562902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.563647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.565413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.580407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1024/2022] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:13.582778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.593156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7bd8-f518-4ec1-b7d1-2affcf290996 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.598284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.598986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.599303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.599581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.600350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.601996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2ec88-7ada-45c1-bc67-389d7f6cd00b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.612908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 999/2023] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:13.617322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.629078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ff16e-81b0-4454-a337-fe300c9efa76 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.634556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.635792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.635792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.636069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] PATH_INFO: `/v3/projects/fdbfd73c86014e328b87d1f18ba4bb7f/users/00714275bd15406cbdbed511ccc0072c/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.653073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbfd73c86014e328b87d1f18ba4bb7f, user_id=00714275bd15406cbdbed511ccc0072c, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.655693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.670334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1025/2024] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:13 2021] PUT /identity/v3/projects/fdbfd73c86014e328b87d1f18ba4bb7f/users/00714275bd15406cbdbed511ccc0072c/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:13.682027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.682321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.682601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.721515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] MFA Rules not processed for user `00714275bd15406cbdbed511ccc0072c`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:13.722744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:13.800734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1000/2025] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:13.805016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.888430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745544e8-f458-4ef6-a096-644eb27c4511 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:13.893959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:13.894705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:13.895002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:13.895283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:13.896090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:13.899329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:13.937338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1026/2026] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:13.941696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:13.953285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531b3a-c704-4eae-aecd-8a446d59d5b2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.010052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.010872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.011238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.011523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.012283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.014232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.042879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1001/2027] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:13 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:14.044536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.055650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f212e-575f-455f-abc3-8dadf9c409be admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.064624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.065777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.066417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.067048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.068327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.071090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.091587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1027/2028] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:14.095884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.115876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d87d8-cd3a-49cc-8021-22260a7ea0b8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.125448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.126542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.126988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.127410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.128364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.130181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb807cfc-895b-429a-a133-624e70dbc078 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.142400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1002/2029] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:14.147013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.158089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3f35-b0ff-4a59-a45c-db5fa8ee0209 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.163212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.164454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.164749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.165029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] PATH_INFO: `/v3/projects/187e3e1041874a9289872ddd5f113e04/users/1e414859063049ef8584d2beaabe182a/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.183720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187e3e1041874a9289872ddd5f113e04, user_id=1e414859063049ef8584d2beaabe182a, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.186690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.205993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1028/2030] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:14 2021] PUT /identity/v3/projects/187e3e1041874a9289872ddd5f113e04/users/1e414859063049ef8584d2beaabe182a/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:14.217904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.218203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.218488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.246026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] MFA Rules not processed for user `1e414859063049ef8584d2beaabe182a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:14.247266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:14.312846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1003/2031] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:14 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:14.317368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.383002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3088-6c32-4c48-8fa8-597c6397c118 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.389371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.392092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.392092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.392092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.392092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.394512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.428305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1029/2032] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:14 2021] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:14.431979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.445522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507d17-42af-49c5-974f-5cb4c8713124 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.501161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.501857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.502142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.502425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.503183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.505198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.527792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1004/2033] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:14 2021] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:14.532059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.543426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862033-90f1-4f2e-b36d-18cc8bb9d085 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.548675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.549406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.549694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.549972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.550729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.552402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.568328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1030/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:14.570511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.583366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74041-da12-4497-89d4-0628b391ecda admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.588271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.589244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.590254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.590536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] PATH_INFO: `/v3/projects/33aa797ba35e4d5596766a46620c5026/users/f6b182b4cc904f0babc5285a26ab21b0/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.605995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33aa797ba35e4d5596766a46620c5026, user_id=f6b182b4cc904f0babc5285a26ab21b0, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.609044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.624676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1005/2035] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:14 2021] PUT /identity/v3/projects/33aa797ba35e4d5596766a46620c5026/users/f6b182b4cc904f0babc5285a26ab21b0/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:14.628838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.639594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341cc65-24d0-4dd5-8550-87c888d6c529 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.695792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.696405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.696704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.696992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.697731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.699407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eb83a-ff1b-4015-9119-1ad0a73ae7e7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.711270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1031/2036] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:14 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:14.715830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.726610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020c4d-9aba-44af-9675-fc3e76d520f2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.732861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.733799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.734080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.734386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] PATH_INFO: `/v3/projects/33aa797ba35e4d5596766a46620c5026/users/f6b182b4cc904f0babc5285a26ab21b0/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.736625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33aa797ba35e4d5596766a46620c5026, user_id=f6b182b4cc904f0babc5285a26ab21b0, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:14.739346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:14.750841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1006/2037] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:14 2021] PUT /identity/v3/projects/33aa797ba35e4d5596766a46620c5026/users/f6b182b4cc904f0babc5285a26ab21b0/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:14.761484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.762485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.762485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:14.792637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] MFA Rules not processed for user `f6b182b4cc904f0babc5285a26ab21b0`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:14.793967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:14.866032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1032/2038] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:14 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:14.878124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:14.879891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:14.967184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e36d-ede6-4c87-82c4-0e16cba7fde9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:14.971516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:14.972257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:14.972541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:14.972922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:15.088200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:15.089694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:15.101430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1007/2039] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:14 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:16.858803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:16.868322 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6d433-3c26-4dc6-9030-4ea926ce863e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:16.872811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:16.873485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:16.873765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:16.874355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:16.933431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:16.935035 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:16.945133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1033/2040] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:16 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:17.741407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:17.750469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac94e0-b420-4dc9-9068-82b83823eb6d service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:17.754752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:17.755383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:17.755673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:17.755944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:17.771910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:17.773615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:17.785179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1008/2041] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:17 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:19.373093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:19.374836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:19.439198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b0f0-89d9-48da-acc6-df6ae6aec9f2 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:19.443820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:19.444751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:19.445059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:19.445368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] PATH_INFO: `/v3/users/1fb422a1adfc46b0a241cb7e82e8d9c0` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:19.446629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb422a1adfc46b0a241cb7e82e8d9c0)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:19.448583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:19.499176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb422a1adfc46b0a241cb7e82e8d9c0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.499983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb422a1adfc46b0a241cb7e82e8d9c0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.513315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb422a1adfc46b0a241cb7e82e8d9c0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.523048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb422a1adfc46b0a241cb7e82e8d9c0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.523873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3ab70b55-53a3-4f96-ad99-e17ffac3600f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb422a1adfc46b0a241cb7e82e8d9c0'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.535874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1034/2042] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:19 2021] DELETE /identity/v3/users/1fb422a1adfc46b0a241cb7e82e8d9c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:19.713818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:19.725574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d182f-3626-4661-96ec-7f115745ca6d service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:19.791837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:19.792723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:19.793214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:19.793495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] PATH_INFO: `/v3/projects/51337e5f01d5448ea9a877b53016681f` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:19.794874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=51337e5f01d5448ea9a877b53016681f)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:19.796814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:19.850597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51337e5f01d5448ea9a877b53016681f', 'request_id': 'req-c25a4765-c523-44df-8af2-c69d21d153ec'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.856961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51337e5f01d5448ea9a877b53016681f', 'request_id': 'req-c25a4765-c523-44df-8af2-c69d21d153ec'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.862715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51337e5f01d5448ea9a877b53016681f', 'request_id': 'req-c25a4765-c523-44df-8af2-c69d21d153ec'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.875615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] The token cache is being invalidate because project 51337e5f01d5448ea9a877b53016681f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:19.875901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.876503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c25a4765-c523-44df-8af2-c69d21d153ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:19.878030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1009/2043] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:19 2021] DELETE /identity/v3/projects/51337e5f01d5448ea9a877b53016681f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:19.884454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:19.884756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:19.885017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:19.902286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:19.903481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:19.961520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1035/2044] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:20.005461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.005732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.006016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.026809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:20.027938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:20.037338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1010/2045] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:20.043386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.057494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cad9e-ea62-43c7-849d-35fb999b3047 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.065911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.066861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.067160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.067433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.068446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:20.068803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.071181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.084393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1036/2046] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:20.090102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.100587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c16010-ca53-4f50-bcef-10c2d8333d95 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.106949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.107619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.107901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.108223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.108947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.110860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.141744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1011/2047] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:20.146104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.156757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff8f6b-02fb-4eac-83a5-bd858e60ff2e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.220574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.221279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.221560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.221827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.222799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.224530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.255889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1037/2048] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:20.257687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.272776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22db34-27dc-4bf0-9ca1-1347f6facfad admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.277877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.278531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.278822 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.279097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.279993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.281913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.300790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1012/2049] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:20.304870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.315323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cfac3-249b-4821-ab1b-fc48c10877ce admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.321099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.321820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.321993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.322260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.324649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.326786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c952cdd-b128-4998-ac9b-bf8572cd41d0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.338078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1038/2050] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:20.342520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.352572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab253-5806-492a-9c90-062d57c3176d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.358045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.358912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.359195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.359469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] PATH_INFO: `/v3/projects/1b77b503f2d946f8a98ee8df39fc388b/users/b7b9244453d94e1f92858bda1acab837/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.377002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b77b503f2d946f8a98ee8df39fc388b, user_id=b7b9244453d94e1f92858bda1acab837, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.380125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.399055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1013/2051] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:20 2021] PUT /identity/v3/projects/1b77b503f2d946f8a98ee8df39fc388b/users/b7b9244453d94e1f92858bda1acab837/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:20.409552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.410422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.410879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.438941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] MFA Rules not processed for user `b7b9244453d94e1f92858bda1acab837`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:20.440202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:20.505228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1039/2052] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:20.510011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.571870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e4cb6-6308-4852-8734-371ce9818300 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.577845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.578539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.578879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.579142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.579887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.581875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.613373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1014/2053] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:20.617623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.628965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d31217-d172-4e53-bb0e-07642114c0a7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.688813 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.689491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.689772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.690051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.690801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.692802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.713498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1040/2054] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:20.717733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.728472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281584-fd89-4890-836e-80bfd12fd17a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.734024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.734725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.735005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.735252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.736028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.737654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.748207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1015/2055] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:20.752650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.764276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674fdb9-2e94-436d-b42e-dfee6cf69aa8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.770194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.771082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.771365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.771640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] PATH_INFO: `/v3/projects/dbfa5fd2427647a9a89f07d866b96418/users/0824c5c1821a4d56b6402b7e743e7fd8/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.787840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfa5fd2427647a9a89f07d866b96418, user_id=0824c5c1821a4d56b6402b7e743e7fd8, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.790825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.804846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1041/2056] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:20 2021] PUT /identity/v3/projects/dbfa5fd2427647a9a89f07d866b96418/users/0824c5c1821a4d56b6402b7e743e7fd8/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:20.808965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.819037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485de93-ee9e-47db-b00f-8fdfd0b24f5e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.874948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.875746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.876032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.876333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.877063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.878666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343288-3457-4b32-8af2-a09910b44161 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.888929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1016/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:20.893459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:20.905084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58398d72-3f9e-4c66-9a86-7a8a5ffd6977 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:20.910280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:20.911241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.911588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.911871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] PATH_INFO: `/v3/projects/dbfa5fd2427647a9a89f07d866b96418/users/0824c5c1821a4d56b6402b7e743e7fd8/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.913958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfa5fd2427647a9a89f07d866b96418, user_id=0824c5c1821a4d56b6402b7e743e7fd8, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:20.916645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:20.927587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1042/2058] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:20 2021] PUT /identity/v3/projects/dbfa5fd2427647a9a89f07d866b96418/users/0824c5c1821a4d56b6402b7e743e7fd8/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:20.938026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:20.938426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:20.938801 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:20.965545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] MFA Rules not processed for user `0824c5c1821a4d56b6402b7e743e7fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:20.966875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:21.036269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1017/2059] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:20 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:21.046924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:21.048707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:21.108687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8390138-d474-4b35-80b3-728fa39a86f9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:21.113357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:21.114009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:21.114290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:21.114564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:21.125084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:21.126541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867d74e-c422-428f-a3f4-1738a1784ee2 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:21.136574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1043/2060] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:21 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:21.428881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:21.493658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6e6c-d260-4c2e-a923-005965a94ddb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:21.498493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:21.499500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:21.499779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:21.500052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] PATH_INFO: `/v3/users/b7b9244453d94e1f92858bda1acab837` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:21.501302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b9244453d94e1f92858bda1acab837)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:21.503244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:21.550608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b9244453d94e1f92858bda1acab837'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:21.551247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b9244453d94e1f92858bda1acab837'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:21.562549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b9244453d94e1f92858bda1acab837'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:21.571204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b9244453d94e1f92858bda1acab837'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:21.584971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b9244453d94e1f92858bda1acab837'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:21.592034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1018/2061] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:21 2021] DELETE /identity/v3/users/b7b9244453d94e1f92858bda1acab837 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:21.596652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:21.597264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:21.597264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:21.618769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:21.620498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:21.688402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1044/2062] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:21.699049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:21.700972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:21.760359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bdee3-3e4d-4c9b-badc-1736b47323c3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:21.764776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:21.765509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:21.765794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:21.766075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:21.776851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:21.778416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:21.788273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1019/2063] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:49:22.080417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:22.082263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:22.102603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ad7af-5ac9-4c27-b210-0145233b188d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:22.108853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:22.109772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:22.110203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:22.110403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] PATH_INFO: `/v3/projects/1b77b503f2d946f8a98ee8df39fc388b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:22.111701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b77b503f2d946f8a98ee8df39fc388b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:22.113948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:22.164099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b77b503f2d946f8a98ee8df39fc388b', 'request_id': 'req-59e0320f-1579-4f2a-84cb-ed5d12103d51'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.170408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b77b503f2d946f8a98ee8df39fc388b', 'request_id': 'req-59e0320f-1579-4f2a-84cb-ed5d12103d51'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.175856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b77b503f2d946f8a98ee8df39fc388b', 'request_id': 'req-59e0320f-1579-4f2a-84cb-ed5d12103d51'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.193379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] The token cache is being invalidate because project 1b77b503f2d946f8a98ee8df39fc388b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:22.193673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.194321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.195910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1045/2064] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:22 2021] DELETE /identity/v3/projects/1b77b503f2d946f8a98ee8df39fc388b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:22.202467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:22.211952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced956ce-3a69-44c3-a189-846a69660278 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:22.280847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:22.281735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:22.282016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:22.282323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] PATH_INFO: `/v3/users/0824c5c1821a4d56b6402b7e743e7fd8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:22.283686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0824c5c1821a4d56b6402b7e743e7fd8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:22.285641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:22.349905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0824c5c1821a4d56b6402b7e743e7fd8'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.350690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0824c5c1821a4d56b6402b7e743e7fd8'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.375996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0824c5c1821a4d56b6402b7e743e7fd8'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.388978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0824c5c1821a4d56b6402b7e743e7fd8'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.402896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-4b26e2c6-9089-4bb6-bdf2-2f2885b16a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0824c5c1821a4d56b6402b7e743e7fd8'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:22.410100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1020/2065] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:22 2021] DELETE /identity/v3/users/0824c5c1821a4d56b6402b7e743e7fd8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:22.856874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:22.859812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:22.882780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0320f-1579-4f2a-84cb-ed5d12103d51 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:22.964854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:22.964854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:22.964854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:22.965139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] PATH_INFO: `/v3/projects/dbfa5fd2427647a9a89f07d866b96418` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:22.966328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfa5fd2427647a9a89f07d866b96418)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:22.968438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.019780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfa5fd2427647a9a89f07d866b96418', 'request_id': 'req-8833d328-d0cc-4141-a06a-abad944f4613'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:23.026541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfa5fd2427647a9a89f07d866b96418', 'request_id': 'req-8833d328-d0cc-4141-a06a-abad944f4613'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:23.033617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfa5fd2427647a9a89f07d866b96418', 'request_id': 'req-8833d328-d0cc-4141-a06a-abad944f4613'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:23.055972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] The token cache is being invalidate because project dbfa5fd2427647a9a89f07d866b96418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:23.056295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:23.057111 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8833d328-d0cc-4141-a06a-abad944f4613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:23.058726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1046/2066] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:22 2021] DELETE /identity/v3/projects/dbfa5fd2427647a9a89f07d866b96418 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:23.065415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.065925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.066228 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.085397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:23.086618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:23.146658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1021/2067] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:23.154807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.155102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.155382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.173953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:23.175161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:23.183351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1047/2068] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:23.187826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.197546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb9ac-8e36-4338-9dd8-b76b3bb2e3c1 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.203202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.204347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.204661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.204984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.205871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:23.206219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.208245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.223826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1022/2069] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:23.228550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.238597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dff3d-7524-4d39-ab30-53d2e9dc48b7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.256312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.257415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.258085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.258692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.260307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.262826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.300183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1048/2070] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:23.302942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.313539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdffc77-b637-414e-b2a0-63ed47deac07 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.373742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.374513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.374804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.375118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.376060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.378227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.402358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1023/2071] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:23.407293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.421412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344106e-4f74-48cc-9df0-196780f1d9a4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.427554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.428918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.429385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.429819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.430760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.432540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.445284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1049/2072] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:23.453170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.463138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f1cf-06b4-4167-a491-7ee0d5cb9915 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.467854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.468770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.469239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.469521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.470275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.471886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c740c-4b3b-4007-b832-c368ff8a14d0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.487467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1024/2073] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:23.488989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.500695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77745-f71d-4f29-850e-d48b96d17f5d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.506000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.507284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.507782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.508285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] PATH_INFO: `/v3/projects/102054a0759e44cb926a6ac4b3ae3d48/users/58e8f5b748dd444e8de911f74019431e/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.529860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102054a0759e44cb926a6ac4b3ae3d48, user_id=58e8f5b748dd444e8de911f74019431e, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.532552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.548356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1050/2074] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:23 2021] PUT /identity/v3/projects/102054a0759e44cb926a6ac4b3ae3d48/users/58e8f5b748dd444e8de911f74019431e/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:23.558952 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.559276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.559518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.603882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] MFA Rules not processed for user `58e8f5b748dd444e8de911f74019431e`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:23.605230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:23.687799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1025/2075] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:23.692631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.771394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c3971-4675-487f-a38d-c1e98faf19d4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.776368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.777147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.777541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.777961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.778700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.780904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:23.814992 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1051/2076] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:23.821650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:23.839565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11bc75-c271-4ebb-9c4e-001e613332b3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:23.963261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:23.964142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:23.964465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:23.964882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:23.967763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:23.970238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.003496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1026/2077] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:23 2021] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:24.004395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.016522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a4ed0-1428-4943-beba-24e267817ed1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.023012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.023884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.024467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.024900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.025895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.027698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.044313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1052/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:24.048904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.061923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4626f-d466-4fbd-9a7d-0b364f43dc67 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.067607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.068598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.068978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.069353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.071590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.073495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.094301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1027/2079] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:24.094612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.102159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.105938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.109427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b16ade-f2ec-43d7-ac90-f894c96285ad admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.124504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.125778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.126202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.126635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] PATH_INFO: `/v3/projects/f5ed6e3480c04033af8cc3a84c08be6e/users/db5e285eb9174a87ae033a0b0d9056fb/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.127494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e01d43-e86c-405d-b106-c2a558ecbccc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.133680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.142814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.143103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.143539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] PATH_INFO: `/v3/users/00714275bd15406cbdbed511ccc0072c` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.145137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00714275bd15406cbdbed511ccc0072c)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.147654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.157029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ed6e3480c04033af8cc3a84c08be6e, user_id=db5e285eb9174a87ae033a0b0d9056fb, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.159682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506e699-fed5-46b9-9a85-e4613c4fb320 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.195624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1053/2080] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:24 2021] PUT /identity/v3/projects/f5ed6e3480c04033af8cc3a84c08be6e/users/db5e285eb9174a87ae033a0b0d9056fb/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:24.208619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.209223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.209682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.256619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00714275bd15406cbdbed511ccc0072c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.258408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00714275bd15406cbdbed511ccc0072c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.287943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] MFA Rules not processed for user `db5e285eb9174a87ae033a0b0d9056fb`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:24.290339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.309785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00714275bd15406cbdbed511ccc0072c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.337531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00714275bd15406cbdbed511ccc0072c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.355263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f2561f19-4c58-44ba-b6dc-106459e0b3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00714275bd15406cbdbed511ccc0072c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.368428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1028/2081] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:24 2021] DELETE /identity/v3/users/00714275bd15406cbdbed511ccc0072c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:24.379298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.380791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.381429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.399202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1054/2082] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:24.403603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.406374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.409934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:24.411429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.488100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df23eed-73c3-4868-8009-fbe32a7ea71b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.494102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1029/2083] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:24.495719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.501658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.504101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.505009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.505298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.505571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.506315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.508320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.514590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44cfc-6579-4674-ae3e-fdefea95847d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.519549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.520493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.520785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.521060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] PATH_INFO: `/v3/users/1949e4e7d2e74a539bf739591e89d2b9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.522328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1949e4e7d2e74a539bf739591e89d2b9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.524328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.539705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1055/2084] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:24 2021] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:24.543768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.545960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.579289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1949e4e7d2e74a539bf739591e89d2b9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.580072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1949e4e7d2e74a539bf739591e89d2b9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.593587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1949e4e7d2e74a539bf739591e89d2b9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.600011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1949e4e7d2e74a539bf739591e89d2b9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.605271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146eb2-7ebf-4d72-a519-5877f14dd16d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.608434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1949e4e7d2e74a539bf739591e89d2b9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:24.609887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.610538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.610825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.611106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.612960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.614581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1030/2085] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:24 2021] DELETE /identity/v3/users/1949e4e7d2e74a539bf739591e89d2b9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:24.618344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.619744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.683862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.685346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.688202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff1ea-6768-4d49-b333-e05cfe5332a8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.693373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.694062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.694346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.694740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.695467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.696001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1056/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:24.697578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.722690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1031/2087] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:24 2021] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:24.723881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.734335 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b37c-628c-446c-932e-8d8989c98b73 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.739267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.739944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.740278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.740780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.741316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.743169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.756194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1057/2088] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:24.759469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.770379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b0220-e118-47c7-9876-cb427c8a5736 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.776001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.777016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.777366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.777750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] PATH_INFO: `/v3/projects/ffd56052833e4879a1fbadd02e3f7725/users/2138909f61774ff5b006ed2e4c5c82df/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.794569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd56052833e4879a1fbadd02e3f7725, user_id=2138909f61774ff5b006ed2e4c5c82df, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.797982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.816236 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1032/2089] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:24 2021] PUT /identity/v3/projects/ffd56052833e4879a1fbadd02e3f7725/users/2138909f61774ff5b006ed2e4c5c82df/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:24.817559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.827984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e445a-5600-4f15-8dfc-12393ce7196e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.862038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.863911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:24.894815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.896435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.896731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.897013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.898727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.900563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.913759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1058/2090] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:24.918685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:24.929737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226ff53-ad51-454e-912f-9494e22ef98a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:24.935346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:24.936872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.937348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.937914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] PATH_INFO: `/v3/projects/ffd56052833e4879a1fbadd02e3f7725/users/2138909f61774ff5b006ed2e4c5c82df/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.941406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd56052833e4879a1fbadd02e3f7725, user_id=2138909f61774ff5b006ed2e4c5c82df, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:24.945816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850571a5-0f22-4fee-9f4d-0019f8ec6917 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:24.964163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1059/2091] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:24 2021] PUT /identity/v3/projects/ffd56052833e4879a1fbadd02e3f7725/users/2138909f61774ff5b006ed2e4c5c82df/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:24.976407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:24.976646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:24.976883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:24.980661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d061b12-389f-452c-addc-cb3ca5499fcc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.009301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] MFA Rules not processed for user `2138909f61774ff5b006ed2e4c5c82df`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:25.010638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.050874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.051788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.052069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.052399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] PATH_INFO: `/v3/projects/008b0d7eb46645bdabe9ee0c4c7652c0` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.053773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008b0d7eb46645bdabe9ee0c4c7652c0)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.055994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.096776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1060/2092] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:24 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:25.097839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:25.099588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.114812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84881-04f2-4882-affc-672f906a7884 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.120186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.121074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.121346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.121622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] PATH_INFO: `/v3/projects/fdbfd73c86014e328b87d1f18ba4bb7f` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.123169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbfd73c86014e328b87d1f18ba4bb7f)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.125178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.134718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008b0d7eb46645bdabe9ee0c4c7652c0', 'request_id': 'req-f556a31e-6357-4cb4-843e-a3c4edb01901'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.140926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008b0d7eb46645bdabe9ee0c4c7652c0', 'request_id': 'req-f556a31e-6357-4cb4-843e-a3c4edb01901'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.148671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008b0d7eb46645bdabe9ee0c4c7652c0', 'request_id': 'req-f556a31e-6357-4cb4-843e-a3c4edb01901'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.162959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] The token cache is being invalidate because project 008b0d7eb46645bdabe9ee0c4c7652c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:25.163249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.163903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.165850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1033/2093] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:24 2021] DELETE /identity/v3/projects/008b0d7eb46645bdabe9ee0c4c7652c0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:25.168876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:25.168876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.174499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbfd73c86014e328b87d1f18ba4bb7f', 'request_id': 'req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.180753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbfd73c86014e328b87d1f18ba4bb7f', 'request_id': 'req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.186567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbfd73c86014e328b87d1f18ba4bb7f', 'request_id': 'req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.199213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] The token cache is being invalidate because project fdbfd73c86014e328b87d1f18ba4bb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:25.199497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.200241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.201925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1061/2094] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:25 2021] DELETE /identity/v3/projects/fdbfd73c86014e328b87d1f18ba4bb7f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:25.205674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:25.207053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.225377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556a31e-6357-4cb4-843e-a3c4edb01901 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.270854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92b83f-2893-4fb1-a4cb-4a180f648fe6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.271973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.272650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.272961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.273227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.275045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.275677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.276619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.276905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.277182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] PATH_INFO: `/v3/users/e7411047fb1d481eab57b4dc5f1459c4` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.278588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7411047fb1d481eab57b4dc5f1459c4)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.280705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.328998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7411047fb1d481eab57b4dc5f1459c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.329818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7411047fb1d481eab57b4dc5f1459c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.343007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.343651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7411047fb1d481eab57b4dc5f1459c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.344526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.353052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7411047fb1d481eab57b4dc5f1459c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.353701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7411047fb1d481eab57b4dc5f1459c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.355053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1034/2095] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:25 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:25.356009 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:25.357800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.368192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1062/2096] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:25 2021] DELETE /identity/v3/users/e7411047fb1d481eab57b4dc5f1459c4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:25.375694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3e8a-4bec-401f-8756-1351d5809125 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.470970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.472097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.472413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.472690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] PATH_INFO: `/v3/users/1e414859063049ef8584d2beaabe182a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.477282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e414859063049ef8584d2beaabe182a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.481064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.593904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e414859063049ef8584d2beaabe182a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.597141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e414859063049ef8584d2beaabe182a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.628476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e414859063049ef8584d2beaabe182a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.639697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e414859063049ef8584d2beaabe182a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.655322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e414859063049ef8584d2beaabe182a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.677755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1035/2097] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:25 2021] DELETE /identity/v3/users/1e414859063049ef8584d2beaabe182a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:25.711339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:25.714836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:25.739518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858f16-33c3-4d85-b65c-ea039fdf96ba admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:25.843235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:25.843235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:25.843531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:25.843806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] PATH_INFO: `/v3/projects/87702e6a0cb2446698353cb27a4d4683` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:25.845276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87702e6a0cb2446698353cb27a4d4683)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:25.847906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:25.927612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87702e6a0cb2446698353cb27a4d4683', 'request_id': 'req-75940078-5332-420c-9e85-3662c16a9981'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.934406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87702e6a0cb2446698353cb27a4d4683', 'request_id': 'req-75940078-5332-420c-9e85-3662c16a9981'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.940410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87702e6a0cb2446698353cb27a4d4683', 'request_id': 'req-75940078-5332-420c-9e85-3662c16a9981'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.958533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] The token cache is being invalidate because project 87702e6a0cb2446698353cb27a4d4683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:25.959057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.960341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:25.962462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1063/2098] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:25 2021] DELETE /identity/v3/projects/87702e6a0cb2446698353cb27a4d4683 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:26.062636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.064358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.080281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.082302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.089812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0be887-ab81-4eb9-ac7a-8b72b4122006 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.165818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940078-5332-420c-9e85-3662c16a9981 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.172584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.173469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.173757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.174032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] PATH_INFO: `/v3/projects/187e3e1041874a9289872ddd5f113e04` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.175256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187e3e1041874a9289872ddd5f113e04)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.177427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:26.189556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.190449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.190734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.191010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] PATH_INFO: `/v3/users/fa77c69b1cb8471b91bafcd7f1565e06` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.192280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa77c69b1cb8471b91bafcd7f1565e06)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.194239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:26.227565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187e3e1041874a9289872ddd5f113e04', 'request_id': 'req-41a1e325-f478-4c9c-80d3-237b4dd831d1'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.235525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187e3e1041874a9289872ddd5f113e04', 'request_id': 'req-41a1e325-f478-4c9c-80d3-237b4dd831d1'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.240987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187e3e1041874a9289872ddd5f113e04', 'request_id': 'req-41a1e325-f478-4c9c-80d3-237b4dd831d1'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.242751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa77c69b1cb8471b91bafcd7f1565e06'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.243429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa77c69b1cb8471b91bafcd7f1565e06'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.255889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa77c69b1cb8471b91bafcd7f1565e06'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.258420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] The token cache is being invalidate because project 187e3e1041874a9289872ddd5f113e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:26.258772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.259499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.261219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1064/2099] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:26 2021] DELETE /identity/v3/projects/187e3e1041874a9289872ddd5f113e04 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:26.264977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.266321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.267243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa77c69b1cb8471b91bafcd7f1565e06'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.276844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa77c69b1cb8471b91bafcd7f1565e06'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.283783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1036/2100] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:26 2021] DELETE /identity/v3/users/fa77c69b1cb8471b91bafcd7f1565e06 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:26.287421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.289021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.325365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1e325-f478-4c9c-80d3-237b4dd831d1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.351958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba957a07-8126-43cb-90d9-eaff0d3ae84c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.357549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.358710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.359000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.359279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] PATH_INFO: `/v3/users/f6b182b4cc904f0babc5285a26ab21b0` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.360704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b182b4cc904f0babc5285a26ab21b0)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.362666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:26.378127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.378805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.379087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.379359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.381427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.413542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b182b4cc904f0babc5285a26ab21b0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.414240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b182b4cc904f0babc5285a26ab21b0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.426681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b182b4cc904f0babc5285a26ab21b0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.433924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b182b4cc904f0babc5285a26ab21b0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.438534 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.440162 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fba5b5-c67c-4852-83f3-d6f842052368 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:26.445259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b182b4cc904f0babc5285a26ab21b0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:26.449823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1065/2101] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:26.451367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aebde-0602-4632-b35b-7a84e6398341 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.451819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aebde-0602-4632-b35b-7a84e6398341 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.452258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aebde-0602-4632-b35b-7a84e6398341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.461685 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1037/2102] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:26 2021] DELETE /identity/v3/users/f6b182b4cc904f0babc5285a26ab21b0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:26.469266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b42aebde-0602-4632-b35b-7a84e6398341 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:26.470506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b42aebde-0602-4632-b35b-7a84e6398341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.540967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1066/2103] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:26.553351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.555091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.619048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188fa6b-944a-41cc-bf68-e02d1b1c2326 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.619528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188fa6b-944a-41cc-bf68-e02d1b1c2326 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.620255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188fa6b-944a-41cc-bf68-e02d1b1c2326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.662206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415543b1-719b-4daf-a8d4-da5f75cef2b9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.662789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8188fa6b-944a-41cc-bf68-e02d1b1c2326 None None] MFA Rules not processed for user `9afb7b5b35cb487ba063c7ee7fbcd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:26.664515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8188fa6b-944a-41cc-bf68-e02d1b1c2326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.671966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.672681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.673231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.673512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.698590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.703371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:26.722055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1038/2104] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:26.799304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1067/2105] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:26.934653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:26.936329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:26.961008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923329-dae7-4006-8cc0-6ef42762e925 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:26.968701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:26.969720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:26.970105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:26.970472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] PATH_INFO: `/v3/projects/33aa797ba35e4d5596766a46620c5026` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:26.971947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33aa797ba35e4d5596766a46620c5026)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:26.974523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.043509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33aa797ba35e4d5596766a46620c5026', 'request_id': 'req-0e186b34-0cc2-4913-89b0-fba52bdd2045'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.051928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33aa797ba35e4d5596766a46620c5026', 'request_id': 'req-0e186b34-0cc2-4913-89b0-fba52bdd2045'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.058489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33aa797ba35e4d5596766a46620c5026', 'request_id': 'req-0e186b34-0cc2-4913-89b0-fba52bdd2045'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.073029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] The token cache is being invalidate because project 33aa797ba35e4d5596766a46620c5026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:27.073449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.074110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.075960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1039/2106] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:26 2021] DELETE /identity/v3/projects/33aa797ba35e4d5596766a46620c5026 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:27.082025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90134c-b806-49c6-89b2-e9466fe9e5c6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.082519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90134c-b806-49c6-89b2-e9466fe9e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.082623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90134c-b806-49c6-89b2-e9466fe9e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.105503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ba90134c-b806-49c6-89b2-e9466fe9e5c6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:27.107102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ba90134c-b806-49c6-89b2-e9466fe9e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.124319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.126137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.170577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1068/2107] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:27.179961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.180321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.180760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.198808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:27.200021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.209263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1069/2108] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:27.213528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.213828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e186b34-0cc2-4913-89b0-fba52bdd2045 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.221090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.222346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.222346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.222870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6329-7f63-48c5-8373-85506dddfe3f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.223131 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] PATH_INFO: `/v3/projects/69821a12fbfa41bf844ddfc834919946` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.224457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69821a12fbfa41bf844ddfc834919946)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.226758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.227618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.228389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.228677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.228958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.229787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:27.230096 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.232034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.244249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1070/2109] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:49:27.249417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.259361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0355d2-2fbb-4036-9be8-51fe2e90742c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.264975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.265695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.265972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.266246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.266981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.268918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.286899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69821a12fbfa41bf844ddfc834919946', 'request_id': 'req-9611f1b2-f260-4217-bf12-5fd8975a18f2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.296022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69821a12fbfa41bf844ddfc834919946', 'request_id': 'req-9611f1b2-f260-4217-bf12-5fd8975a18f2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.299900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1071/2110] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:27 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:27.304279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.305678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69821a12fbfa41bf844ddfc834919946', 'request_id': 'req-9611f1b2-f260-4217-bf12-5fd8975a18f2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.323234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] The token cache is being invalidate because project 69821a12fbfa41bf844ddfc834919946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:27.323575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.324262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.325893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1040/2111] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:27 2021] DELETE /identity/v3/projects/69821a12fbfa41bf844ddfc834919946 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:27.330305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.332344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.370714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895fd7-90bd-48b0-855d-6f6afe772860 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.375662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.376370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.376654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.376929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.377643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.379597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.401323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1072/2112] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:27 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:27.404286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f1b2-f260-4217-bf12-5fd8975a18f2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.405993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.407730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.410107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.411178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.411520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.411795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] PATH_INFO: `/v3/users/dd0a55b875414559a0dc57b7f682abe9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.413062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0a55b875414559a0dc57b7f682abe9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.415042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.420396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e78722-0571-4aef-b434-c51e5ca53512 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.425903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.426664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.427236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.427236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.427942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.429592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.440130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1073/2113] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:27.444399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.454713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26899-7294-4f00-8365-bcfe82687002 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.459406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.460167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.460470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.460744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.461484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.463105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.474101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1074/2114] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:27.478791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.489171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0a55b875414559a0dc57b7f682abe9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.490190 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0a55b875414559a0dc57b7f682abe9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.490507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a58e9-2180-45fc-8507-441aadd6252c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.496117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.497076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.497465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.497721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] PATH_INFO: `/v3/projects/f589a625d7db445091f6729e449426e9/users/22c24beea0b341a7b8d9fa29cc10f6a4/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.510800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0a55b875414559a0dc57b7f682abe9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.514104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f589a625d7db445091f6729e449426e9, user_id=22c24beea0b341a7b8d9fa29cc10f6a4, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.517307 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d6596-1e28-4f38-b940-eb48fb55898d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.521267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0a55b875414559a0dc57b7f682abe9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.530362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0a55b875414559a0dc57b7f682abe9'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:27.532715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1075/2115] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:27 2021] PUT /identity/v3/projects/f589a625d7db445091f6729e449426e9/users/22c24beea0b341a7b8d9fa29cc10f6a4/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:27.538071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1041/2116] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:27 2021] DELETE /identity/v3/users/dd0a55b875414559a0dc57b7f682abe9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:27.538882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.538882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.539301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.563059 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:27.564356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.647021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1076/2117] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:27.659724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.665036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.738346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c477179-36fe-4ef4-a661-f3395468bc8b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.742847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.744322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.744581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.744840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.774638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.776689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ee053-5481-466f-b54b-ffb98171660a service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:27.789715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1042/2118] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:27.951215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:27.952942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:27.973282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20791-28b1-4955-8ea8-93c608540190 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:27.978394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:27.979358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:27.979727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:27.980218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] PATH_INFO: `/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:27.981820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dafd80b9df5486dbc9ac65b00a270f1)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:27.984242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.079572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dafd80b9df5486dbc9ac65b00a270f1', 'request_id': 'req-dd8e992a-8771-4070-b29d-71e2950aabaa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:28.085840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dafd80b9df5486dbc9ac65b00a270f1', 'request_id': 'req-dd8e992a-8771-4070-b29d-71e2950aabaa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:28.093198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dafd80b9df5486dbc9ac65b00a270f1', 'request_id': 'req-dd8e992a-8771-4070-b29d-71e2950aabaa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:28.110263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] The token cache is being invalidate because project 3dafd80b9df5486dbc9ac65b00a270f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:28.110871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:28.112039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-dd8e992a-8771-4070-b29d-71e2950aabaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:28.113704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1077/2119] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:27 2021] DELETE /identity/v3/projects/3dafd80b9df5486dbc9ac65b00a270f1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:28.119362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.119874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.120240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.147010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:28.149113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:28.233962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1043/2120] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:28.247267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.248133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.248707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.270194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:28.272031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:28.283528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1078/2121] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:28.289533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.302743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9b34b-6acb-4785-bc65-aa07334f39bf None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.308292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.309022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.309315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.309559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.310327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:28.310739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.312990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.329389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1044/2122] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:28.330679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.340557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113e86-d1bf-4591-806f-f6e4df4c57de None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.347462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.348856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.348856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.348856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.349517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.351530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.380661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1079/2123] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:28.385118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.396598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98a679-0d4e-4f9e-8696-da4ee9eb8798 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.452519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.453206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.453485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.453793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.454485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.456487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.476161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1045/2124] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:28.480283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.490700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e394301-feb9-41bc-b2f8-f68ad4993724 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.495743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.496438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.496716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.496986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.497721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.499528 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.513625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1080/2125] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:28.514938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.525604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c26c9-c356-4381-b002-1488022a9007 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.530625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.531313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.531611 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.531875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.532680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.534329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efb3c9-6bdf-47f6-ab58-0c0d0ca6891a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.544752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1046/2126] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:28.548846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.559409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18d3f-c07c-4161-af15-e0c8ea1b4dee admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.568070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.568070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.568070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.568070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] PATH_INFO: `/v3/projects/25bde0c2e22d44baa009cb7bc7b36516/users/ffd853100ab147a6a9d3bdfce0f4d5d2/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.590787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bde0c2e22d44baa009cb7bc7b36516, user_id=ffd853100ab147a6a9d3bdfce0f4d5d2, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.594193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77f28a-f73d-4baf-afb0-2049933f5a8e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.613602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1081/2127] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:28 2021] PUT /identity/v3/projects/25bde0c2e22d44baa009cb7bc7b36516/users/ffd853100ab147a6a9d3bdfce0f4d5d2/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:28.623604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.624118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.624438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.664560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.664846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.665145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.678071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] MFA Rules not processed for user `ffd853100ab147a6a9d3bdfce0f4d5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:28.689813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:28.699421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] MFA Rules not processed for user `22c24beea0b341a7b8d9fa29cc10f6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:28.701561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:28.795731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1082/2128] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:28.807794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.810613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:28.815883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1047/2129] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:28.816924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.889294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847559-cc78-4b67-a2e0-65c4df7a872a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.895860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.896693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.897038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.897471 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.906603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9f393-3a23-4434-85f7-383a88125172 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:28.906772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.908359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.912085 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:28.913034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:28.913414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:28.913789 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:28.914629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:28.916833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:28.924402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1083/2130] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:28 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:49:28.970686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1048/2131] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:28.971815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:28.985373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9477823-22ba-4db6-839a-f52326b04698 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.081079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.082419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.083033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.083368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.084560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.099720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.123858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1084/2132] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:28 2021] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:29.127827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.139876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b885-5ef8-4ead-9d5d-a202f2a11f7f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.145028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.145759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.146041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.146310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.147145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.148905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.160145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1049/2133] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:29.164302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.176986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06817502-8616-4d17-9efb-81adaf974fb4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.182009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.182909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.183189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.183455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] PATH_INFO: `/v3/projects/d6223f820b24451cbedcec8d2acd1377/users/b280fd0b010b4e48a020b8cf5b26b521/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.200676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6223f820b24451cbedcec8d2acd1377, user_id=b280fd0b010b4e48a020b8cf5b26b521, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.203662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.241542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1085/2134] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:29 2021] PUT /identity/v3/projects/d6223f820b24451cbedcec8d2acd1377/users/b280fd0b010b4e48a020b8cf5b26b521/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:29.246210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.261993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125cb3-03db-4920-9a63-0991f8019c68 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.341631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.344306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.344597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.344909 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.346565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.348577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8b1df-fe40-4c62-a4bf-2e9ef8536315 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.361910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1050/2135] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:29.365814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.382247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313250e-9157-4557-901f-45f8fb6d52cc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.387721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.388730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.389014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.389287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] PATH_INFO: `/v3/projects/d6223f820b24451cbedcec8d2acd1377/users/b280fd0b010b4e48a020b8cf5b26b521/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.391530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6223f820b24451cbedcec8d2acd1377, user_id=b280fd0b010b4e48a020b8cf5b26b521, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.394216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.407011 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1086/2136] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:29 2021] PUT /identity/v3/projects/d6223f820b24451cbedcec8d2acd1377/users/b280fd0b010b4e48a020b8cf5b26b521/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:29.417684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.417969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.418242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.450480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] MFA Rules not processed for user `b280fd0b010b4e48a020b8cf5b26b521`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:29.451933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:29.539552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1051/2137] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:29 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:29.549944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.551712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:29.655320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e40cb2-4e8a-4746-acf0-dc9667364824 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.661357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.663381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.663576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.664124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.677055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.679971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab21de-d680-4a43-aee7-fa9d6a651fb3 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.692666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1087/2138] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:29 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:29.857631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:29.872625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2494a8-34b5-437a-83a5-ca726eb84faf None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:29.880377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:29.889469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:29.889836 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:29.890375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:29.981905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:29.985804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:29.997171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1052/2139] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:29 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:30.395036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:30.395489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:30.395489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:30.415426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] MFA Rules not processed for user `22c24beea0b341a7b8d9fa29cc10f6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:30.416706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:30.492175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1088/2140] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:30 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:30.791814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:30.802531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f665f0b-4e3e-411e-bab5-ca57739f7962 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:30.807043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:30.808200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:30.808200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:30.808417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:30.810317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:30.874089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:30.875776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:30.885016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1053/2141] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:40.469319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:40.471192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:40.541195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4584-69b2-479a-bbd3-1b098600de8a None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:40.546050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:40.547038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.547445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.547948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] PATH_INFO: `/v3/users/58e8f5b748dd444e8de911f74019431e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.549565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e8f5b748dd444e8de911f74019431e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:40.551725 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:40.612194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e8f5b748dd444e8de911f74019431e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.613117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e8f5b748dd444e8de911f74019431e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.614553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:40.625685 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862f053-c450-4621-837f-abb1ddd3310f service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:40.628625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e8f5b748dd444e8de911f74019431e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.630689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:40.631622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.631913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.632220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] PATH_INFO: `/v3/users/ffd853100ab147a6a9d3bdfce0f4d5d2` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.633809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd853100ab147a6a9d3bdfce0f4d5d2)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:40.635724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:40.638244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e8f5b748dd444e8de911f74019431e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.638747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-57df2732-9e59-4f8d-8c04-cb94552ded80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e8f5b748dd444e8de911f74019431e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.658583 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1089/2142] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:40 2021] DELETE /identity/v3/users/58e8f5b748dd444e8de911f74019431e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:40.660477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.661193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.661316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.681173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:40.682494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:40.698276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd853100ab147a6a9d3bdfce0f4d5d2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.699119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd853100ab147a6a9d3bdfce0f4d5d2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.713441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd853100ab147a6a9d3bdfce0f4d5d2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.722469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd853100ab147a6a9d3bdfce0f4d5d2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.732894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-560266c2-48dc-46ab-b1a0-bedbcaa8883a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd853100ab147a6a9d3bdfce0f4d5d2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:40.745300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1054/2143] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:40 2021] DELETE /identity/v3/users/ffd853100ab147a6a9d3bdfce0f4d5d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:40.747251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.747641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.748034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.767822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1090/2144] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:40.771653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:40.773361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:40.778782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:40.780513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:40.843115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1055/2145] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:40.853689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e6aa8-4967-45e6-9655-221de05759e6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:40.854375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:40.920574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:40.933477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.933837 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.934184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.947744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:40.949460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:40.956963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3383-d19b-4bf2-9dd9-93f1ed085671 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:40.961232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:40.962662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:40.963007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:40.963529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:40.964701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1091/2146] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:49:40.985684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:40.987769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:40.999615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1056/2147] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:41.514280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:41.522880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:41.537757 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d499-bea9-4426-920c-7c88fa9229c2 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:41.544061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:41.545178 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:41.545524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:41.545934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] PATH_INFO: `/v3/projects/102054a0759e44cb926a6ac4b3ae3d48` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:41.547932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=102054a0759e44cb926a6ac4b3ae3d48)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:41.550238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:41.604353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102054a0759e44cb926a6ac4b3ae3d48', 'request_id': 'req-f35645a8-23ec-42c2-a275-9203857a0b0e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.614286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102054a0759e44cb926a6ac4b3ae3d48', 'request_id': 'req-f35645a8-23ec-42c2-a275-9203857a0b0e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.626794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102054a0759e44cb926a6ac4b3ae3d48', 'request_id': 'req-f35645a8-23ec-42c2-a275-9203857a0b0e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.641298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] The token cache is being invalidate because project 102054a0759e44cb926a6ac4b3ae3d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:41.641656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.642330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.644007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1092/2148] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:41 2021] DELETE /identity/v3/projects/102054a0759e44cb926a6ac4b3ae3d48 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:41.649325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:41.651432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:41.652995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:41.662568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06007-39dd-424d-acc1-e4e0dc079435 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:41.719046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:41.720366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35645a8-23ec-42c2-a275-9203857a0b0e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:41.720589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:41.720995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:41.721281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] PATH_INFO: `/v3/users/db5e285eb9174a87ae033a0b0d9056fb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:41.722526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5e285eb9174a87ae033a0b0d9056fb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:41.724487 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:41.725478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:41.726330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:41.726609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:41.726909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] PATH_INFO: `/v3/projects/25bde0c2e22d44baa009cb7bc7b36516` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:41.728094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bde0c2e22d44baa009cb7bc7b36516)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:41.729990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:41.778197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5e285eb9174a87ae033a0b0d9056fb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.778826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5e285eb9174a87ae033a0b0d9056fb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.782564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bde0c2e22d44baa009cb7bc7b36516', 'request_id': 'req-da74236d-2486-4f57-90e6-e308060e9cfd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.788876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bde0c2e22d44baa009cb7bc7b36516', 'request_id': 'req-da74236d-2486-4f57-90e6-e308060e9cfd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.794559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5e285eb9174a87ae033a0b0d9056fb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.795149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bde0c2e22d44baa009cb7bc7b36516', 'request_id': 'req-da74236d-2486-4f57-90e6-e308060e9cfd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.801872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5e285eb9174a87ae033a0b0d9056fb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.810510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] The token cache is being invalidate because project 25bde0c2e22d44baa009cb7bc7b36516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:41.811026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.812121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.812315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5e285eb9174a87ae033a0b0d9056fb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:41.815266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1093/2149] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:41 2021] DELETE /identity/v3/projects/25bde0c2e22d44baa009cb7bc7b36516 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:41.820343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1057/2150] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:41 2021] DELETE /identity/v3/users/db5e285eb9174a87ae033a0b0d9056fb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:41.820770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:41.822516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:41.926606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74236d-2486-4f57-90e6-e308060e9cfd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.026117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.027010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.028250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.028439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] PATH_INFO: `/v3/users/b280fd0b010b4e48a020b8cf5b26b521` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.032777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b280fd0b010b4e48a020b8cf5b26b521)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.038103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.101301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b280fd0b010b4e48a020b8cf5b26b521'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.102034 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b280fd0b010b4e48a020b8cf5b26b521'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.114681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b280fd0b010b4e48a020b8cf5b26b521'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.123821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b280fd0b010b4e48a020b8cf5b26b521'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.124584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b280fd0b010b4e48a020b8cf5b26b521'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.144327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1094/2151] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:41 2021] DELETE /identity/v3/users/b280fd0b010b4e48a020b8cf5b26b521 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:42.195221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:42.196798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:42.214169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e920f-f6d1-49a5-92b0-34c39229a18c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.286310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.287200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.287478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.287755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] PATH_INFO: `/v3/projects/f5ed6e3480c04033af8cc3a84c08be6e` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.289411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ed6e3480c04033af8cc3a84c08be6e)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.291547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.366536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ed6e3480c04033af8cc3a84c08be6e', 'request_id': 'req-b746b85e-1f5f-4450-8c3c-55b477246519'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.377521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ed6e3480c04033af8cc3a84c08be6e', 'request_id': 'req-b746b85e-1f5f-4450-8c3c-55b477246519'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.383982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ed6e3480c04033af8cc3a84c08be6e', 'request_id': 'req-b746b85e-1f5f-4450-8c3c-55b477246519'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.400479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] The token cache is being invalidate because project f5ed6e3480c04033af8cc3a84c08be6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:42.400792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.401446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.403132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1058/2152] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:42 2021] DELETE /identity/v3/projects/f5ed6e3480c04033af8cc3a84c08be6e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:42.408708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:42.410556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:42.426416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04493ecf-af9f-46ab-8a33-6419050bbe87 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.469585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:42.471066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:42.519652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.520741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.521235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.521752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] PATH_INFO: `/v3/users/2138909f61774ff5b006ed2e4c5c82df` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.523115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2138909f61774ff5b006ed2e4c5c82df)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.525958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.594550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746b85e-1f5f-4450-8c3c-55b477246519 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.599303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2138909f61774ff5b006ed2e4c5c82df'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.599450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.600355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.600526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2138909f61774ff5b006ed2e4c5c82df'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.600650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.600903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] PATH_INFO: `/v3/projects/d6223f820b24451cbedcec8d2acd1377` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.602709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6223f820b24451cbedcec8d2acd1377)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.604214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.615949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2138909f61774ff5b006ed2e4c5c82df'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.644691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2138909f61774ff5b006ed2e4c5c82df'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.645442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-40d7c378-2255-495a-851e-cf4c857c24d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2138909f61774ff5b006ed2e4c5c82df'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.666293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1095/2153] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:42 2021] DELETE /identity/v3/users/2138909f61774ff5b006ed2e4c5c82df => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:42.686237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6223f820b24451cbedcec8d2acd1377', 'request_id': 'req-6b7e24dd-a307-4ed7-a566-f26b5a702905'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.695328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6223f820b24451cbedcec8d2acd1377', 'request_id': 'req-6b7e24dd-a307-4ed7-a566-f26b5a702905'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.705198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6223f820b24451cbedcec8d2acd1377', 'request_id': 'req-6b7e24dd-a307-4ed7-a566-f26b5a702905'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.722710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] The token cache is being invalidate because project d6223f820b24451cbedcec8d2acd1377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:42.722999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.723639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6b7e24dd-a307-4ed7-a566-f26b5a702905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:42.725744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1059/2154] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:42 2021] DELETE /identity/v3/projects/d6223f820b24451cbedcec8d2acd1377 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:42.731906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.733000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.733587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.766603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:42.766603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:42.839361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1096/2155] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:42.848474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.848761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.849031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.874470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:42.875731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:42.887103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1060/2156] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:42.891681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:42.905596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6844d-e58c-4403-a8ca-4dabf089a209 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.912894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.913676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.914052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.914416 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.915317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:42.915793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.917664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.931343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1097/2157] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:42.935894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:42.946084 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ed5c5-2c55-4f55-84d4-d8e8daf1e50f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:42.955055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:42.955740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:42.956023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:42.956327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:42.957054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:42.959031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:42.992242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1061/2158] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:42 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:42.992442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.003895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81a2a8-0b83-4917-9b40-d08e61df032f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.031651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.033601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.102999 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.104465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.104909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.105516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.106723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.108925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.110983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92efb9-b9d2-4b40-974e-7b0cfee9c8c8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.115950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.116975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.117418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.117770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] PATH_INFO: `/v3/projects/ffd56052833e4879a1fbadd02e3f7725` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.120623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd56052833e4879a1fbadd02e3f7725)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.122689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.140732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1098/2159] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:42 2021] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:43.145276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.158454 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34c57d-cd8d-43e4-a972-242c25845fe6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.173757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd56052833e4879a1fbadd02e3f7725', 'request_id': 'req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:43.182766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd56052833e4879a1fbadd02e3f7725', 'request_id': 'req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:43.191710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd56052833e4879a1fbadd02e3f7725', 'request_id': 'req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:43.211424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] The token cache is being invalidate because project ffd56052833e4879a1fbadd02e3f7725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:43.212054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:43.212956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-924ef2bb-7eb9-4e3d-92fa-da4db3156b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:43.214703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1062/2160] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:43 2021] DELETE /identity/v3/projects/ffd56052833e4879a1fbadd02e3f7725 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:43.222669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0807-9757-49cb-8922-6b94a4fa8d92 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.223274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0807-9757-49cb-8922-6b94a4fa8d92 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.223581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0807-9757-49cb-8922-6b94a4fa8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.230323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.231481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.231887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.232311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.233205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.234976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.245336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-aa7b0807-9757-49cb-8922-6b94a4fa8d92 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:43.246874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-aa7b0807-9757-49cb-8922-6b94a4fa8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.251690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1099/2161] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:43.253030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.255964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.273322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1063/2162] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:43.275107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.275403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.275684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.278872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8627c8b-97d1-46b4-8ea9-9a52f5a2b3e8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.285043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.285723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.286053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.286337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.287089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.288845 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.297818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:43.299095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.300588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1100/2163] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:43.304848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.316026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1064/2164] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:43.316330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5866-a953-4776-b35c-c1e457b2f330 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.317133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.327695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.328662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.328947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.329320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] PATH_INFO: `/v3/projects/f166e3a54a1241d983397f8518eb37ee/users/07a928703caf43d3af6c9951631657b2/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.335641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295a631-eb21-419b-9678-64ba3246a98b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.340833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.341500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.341785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.342062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.342813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:43.343119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.345010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.347679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f166e3a54a1241d983397f8518eb37ee, user_id=07a928703caf43d3af6c9951631657b2, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.350493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd0e99-c28b-43fe-b518-e2c6341ffed4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.358335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1065/2165] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:49:43.362863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.368704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1101/2166] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:43 2021] PUT /identity/v3/projects/f166e3a54a1241d983397f8518eb37ee/users/07a928703caf43d3af6c9951631657b2/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:43.376708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b8e0-1965-424e-b719-e610c4c51ea0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.380611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.381020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.381426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.412751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] MFA Rules not processed for user `07a928703caf43d3af6c9951631657b2`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:43.415669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.491030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.492113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.492113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.492333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.493405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.495572 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.506848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1102/2167] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:43.519193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.520848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.530700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1066/2168] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:43.535003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.584468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5650f-893f-4215-8d71-4e1f80961a4b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.599934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19777ffa-77ab-4bf2-b3db-0ea0e14972aa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.604733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.605433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.605728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.606351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.607064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.609068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.631588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1067/2169] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:43.632835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.633511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.633799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.634081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.635533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.645510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9bc36-7ec8-44b6-b539-1e8bafbc760e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.652417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.654214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.654683 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.655144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.655885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.657816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.668757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1068/2170] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:43.672990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.682713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29158f3-9961-407f-8359-f99ca6359cae admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.687294 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.687983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.688306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.688581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.689320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.690912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.695107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.696719 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618d06f-3c04-41df-ae57-3cf16f6c31b7 service glance] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.701519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1069/2171] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:43.705623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.706860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1103/2172] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:43 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:43.715364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1489c5-a5a8-4e16-a907-8283c1a43a78 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.720508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.721413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.721696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.721969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] PATH_INFO: `/v3/projects/99e9c8df4a324bc29e00c0a006249d84/users/a44786d2607b4b04bfb718ebafbde4be/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.737784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e9c8df4a324bc29e00c0a006249d84, user_id=a44786d2607b4b04bfb718ebafbde4be, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.740904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.754912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1070/2173] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:43 2021] PUT /identity/v3/projects/99e9c8df4a324bc29e00c0a006249d84/users/a44786d2607b4b04bfb718ebafbde4be/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:49:43.767050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.767320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.767637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.797742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] MFA Rules not processed for user `a44786d2607b4b04bfb718ebafbde4be`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:43.799118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:43.869700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1104/2174] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:43.874143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.934154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8a52d-7796-46d9-8381-9247221e2abb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:43.939065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:43.939735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:43.940018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:43.940328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:43.941045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:43.942960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:43.970157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1071/2175] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:43.974457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:43.985908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8e241-5dbf-4d5e-b900-838356280e15 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.044553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.045231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.045505 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.045781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.046481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.048763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.068788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1105/2176] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:43 2021] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:49:44.072845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.084867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438cf2-e242-436a-aa7e-3888e5abc6d9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.090188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.090860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.091376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.091655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.092659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.095138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.108482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1072/2177] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:44.113133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.124704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dee5d-5e78-4986-b3ab-5b135d7d5c98 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.129701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.130625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.130902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.131174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] PATH_INFO: `/v3/projects/b488b76186464fbaa1606ac4e8604497/users/004fb2c3dec04a3f9b061500033636f3/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.147210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b488b76186464fbaa1606ac4e8604497, user_id=004fb2c3dec04a3f9b061500033636f3, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.149868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.165251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1106/2178] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:44 2021] PUT /identity/v3/projects/b488b76186464fbaa1606ac4e8604497/users/004fb2c3dec04a3f9b061500033636f3/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:44.169123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.180100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb88478-6351-414a-a0a1-364083183942 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.236653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.237320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.237607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.237882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.238734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.240405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd90114-1884-4387-ae7e-d51879fb9ae7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.250360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1073/2179] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:44.254647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.265070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb370-0d00-493c-a275-85edaa155979 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.269988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.270872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.271153 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.271428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] PATH_INFO: `/v3/projects/b488b76186464fbaa1606ac4e8604497/users/004fb2c3dec04a3f9b061500033636f3/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.273463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b488b76186464fbaa1606ac4e8604497, user_id=004fb2c3dec04a3f9b061500033636f3, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.276097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.286530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1107/2180] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:44 2021] PUT /identity/v3/projects/b488b76186464fbaa1606ac4e8604497/users/004fb2c3dec04a3f9b061500033636f3/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:44.297594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.297912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.298203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.324768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] MFA Rules not processed for user `004fb2c3dec04a3f9b061500033636f3`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:44.326012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:44.394432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1074/2181] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:44 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:44.407257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.409167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:44.463303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395927a-589e-41b8-a80e-5d057b5ddccc admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.466949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.467619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.467903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.468182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.477615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.479043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261bbd2-934f-4160-a65f-81c164710184 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.489183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1108/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:44 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:44.610470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.674117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82c862-1122-462c-8e41-62e886fa1e6a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.678869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.679741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.680024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.680334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] PATH_INFO: `/v3/users/a44786d2607b4b04bfb718ebafbde4be` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.681555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44786d2607b4b04bfb718ebafbde4be)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.683475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.736811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44786d2607b4b04bfb718ebafbde4be'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:44.737510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44786d2607b4b04bfb718ebafbde4be'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:44.750165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44786d2607b4b04bfb718ebafbde4be'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:44.757220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44786d2607b4b04bfb718ebafbde4be'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:44.766470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44786d2607b4b04bfb718ebafbde4be'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:44.772488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1075/2183] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:44 2021] DELETE /identity/v3/users/a44786d2607b4b04bfb718ebafbde4be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:44.777184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.777647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.777781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.795710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:44.796958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:44.856752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1109/2184] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:44.867151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:44.868602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:44.922601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dab232-1561-4363-aa13-666788b2128c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:44.926466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:44.927109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:44.927395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:44.927675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:44.936676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:44.938315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:44.947824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1076/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:49:45.213370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:45.215460 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:45.228744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba9b4-52db-43ea-bf16-071daf2daaf0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:45.234978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:45.236398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:45.236802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:45.236935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] PATH_INFO: `/v3/projects/99e9c8df4a324bc29e00c0a006249d84` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:45.238439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e9c8df4a324bc29e00c0a006249d84)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:45.240571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:45.290537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e9c8df4a324bc29e00c0a006249d84', 'request_id': 'req-d0226a97-b479-43e0-bbb9-0dbefe910f24'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.296576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e9c8df4a324bc29e00c0a006249d84', 'request_id': 'req-d0226a97-b479-43e0-bbb9-0dbefe910f24'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.302355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e9c8df4a324bc29e00c0a006249d84', 'request_id': 'req-d0226a97-b479-43e0-bbb9-0dbefe910f24'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.316069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] The token cache is being invalidate because project 99e9c8df4a324bc29e00c0a006249d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:45.316387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.317015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.318580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1110/2186] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:45 2021] DELETE /identity/v3/projects/99e9c8df4a324bc29e00c0a006249d84 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:45.322748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:45.332689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae8cad-077f-4fc0-a0bc-53da69c8ad7b service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:45.388140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:45.388953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:45.389225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:45.389492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] PATH_INFO: `/v3/users/004fb2c3dec04a3f9b061500033636f3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:45.390935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] RBAC: Authorizing `identity:delete_user(user_id=004fb2c3dec04a3f9b061500033636f3)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:45.392929 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:45.439649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004fb2c3dec04a3f9b061500033636f3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.440390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004fb2c3dec04a3f9b061500033636f3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.452103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004fb2c3dec04a3f9b061500033636f3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.458670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004fb2c3dec04a3f9b061500033636f3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.466896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9f074b9-3d31-4641-b4bc-cc030945203d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004fb2c3dec04a3f9b061500033636f3'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.473436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1077/2187] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:45 2021] DELETE /identity/v3/users/004fb2c3dec04a3f9b061500033636f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:45.764022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:45.765895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:45.779748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0226a97-b479-43e0-bbb9-0dbefe910f24 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:45.838015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:45.838906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:45.839170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:45.839449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] PATH_INFO: `/v3/projects/b488b76186464fbaa1606ac4e8604497` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:45.840692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b488b76186464fbaa1606ac4e8604497)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:45.842581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:45.891233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b488b76186464fbaa1606ac4e8604497', 'request_id': 'req-bcef1b25-e705-4738-b8fc-726b7d63e142'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.897733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b488b76186464fbaa1606ac4e8604497', 'request_id': 'req-bcef1b25-e705-4738-b8fc-726b7d63e142'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.903133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b488b76186464fbaa1606ac4e8604497', 'request_id': 'req-bcef1b25-e705-4738-b8fc-726b7d63e142'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.916014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] The token cache is being invalidate because project b488b76186464fbaa1606ac4e8604497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:45.916333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.916947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-bcef1b25-e705-4738-b8fc-726b7d63e142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:45.918483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1111/2188] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:45 2021] DELETE /identity/v3/projects/b488b76186464fbaa1606ac4e8604497 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:45.927803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:45.928352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:45.928448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:45.945829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:45.947025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:46.006708 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1078/2189] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:46.019619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.019907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.020211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.043760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:46.045695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:46.055222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1112/2190] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:46.059702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.069762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18784-8a9c-4dba-a4a1-ababa8b17c7d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.075767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.076457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.076742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.077023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.077777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:46.078086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.079740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.091831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1079/2191] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:46.096561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.108113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee3fd-c9c2-47bc-8e85-09cd5506d332 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.113915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.114570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.114850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.115121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.115877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.117899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.147894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1113/2192] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:46 2021] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:46.155299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.165898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edf6f-2b96-469b-b1bf-5ff97e857229 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.223324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.224004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.224320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.224599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.225326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.227389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.256804 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1080/2193] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:46 2021] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:46.263161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.275436 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23817862-8037-4d3b-8e42-dbb114fd5ed6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.281123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.281856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.282196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.282474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.283243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.284900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.296244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1114/2194] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:49:46.301079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.311464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c86ab0-24d8-49ea-bb29-d65ca7a395c0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.316573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.317227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.317512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.317786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.318570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.320255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c150ce-996a-4628-a35c-dfc3e7776339 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.330651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1081/2195] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:46.334875 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.345934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23287057-312e-4fba-bd0a-596696756ffa admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.351892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.352833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.353127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.353404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] PATH_INFO: `/v3/projects/319b7997a9f7490f924cc5c223229190/users/c48e46fa9ef44a30aaab9555ad19769b/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.370904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b7997a9f7490f924cc5c223229190, user_id=c48e46fa9ef44a30aaab9555ad19769b, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.373633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.389931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1115/2196] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:46 2021] PUT /identity/v3/projects/319b7997a9f7490f924cc5c223229190/users/c48e46fa9ef44a30aaab9555ad19769b/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:46.401840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.402174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.402622 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.439374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] MFA Rules not processed for user `c48e46fa9ef44a30aaab9555ad19769b`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:46.440764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:46.506593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1082/2197] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:46 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:46.520519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:46.523294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:46.588200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4060bc-a26f-442e-9d0a-a4af61ae214b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:46.592905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:46.593570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:46.593868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:46.594234 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:46.608983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:46.611367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3effb-345a-400b-a0fb-7257c611d2eb service glance] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:46.630086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1116/2198] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:46 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:52.722680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:52.724351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:52.793281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bacbae-308e-4134-8159-b39ad8c0c03b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:52.798976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:52.800638 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:52.801008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:52.801353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] PATH_INFO: `/v3/users/11935130e64147e08ffe773859c459cd` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:52.802662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=11935130e64147e08ffe773859c459cd)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:52.804728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:52.864688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11935130e64147e08ffe773859c459cd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:52.865435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11935130e64147e08ffe773859c459cd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:52.883345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11935130e64147e08ffe773859c459cd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:52.891639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11935130e64147e08ffe773859c459cd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:52.904321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11935130e64147e08ffe773859c459cd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:52.911707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1083/2199] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:49:52 2021] DELETE /identity/v3/users/11935130e64147e08ffe773859c459cd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:52.917150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:52.919656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:52.919971 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:52.946738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:52.948433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:53.011117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1117/2200] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:49:53.021464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.023039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:53.082802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f180-9d39-4817-8603-bdc576f6a0ac admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.086943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.087588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.087865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.088140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.098098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.099486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26472abc-fb76-44a5-966a-df2a69fd0bbe service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.109568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1084/2201] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:49:53.406306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.407796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:53.419879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6611d8-f379-4faa-9ec9-64a7ebdb6220 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.425169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.426067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.426432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.426669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] PATH_INFO: `/v3/projects/9c0f2a4bac6a48bfa43491b3b977b15f` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.427941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0f2a4bac6a48bfa43491b3b977b15f)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.430128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.484909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0f2a4bac6a48bfa43491b3b977b15f', 'request_id': 'req-b8862b01-a261-44b5-af7c-bf1d400e3d55'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:53.492792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0f2a4bac6a48bfa43491b3b977b15f', 'request_id': 'req-b8862b01-a261-44b5-af7c-bf1d400e3d55'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:53.499746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0f2a4bac6a48bfa43491b3b977b15f', 'request_id': 'req-b8862b01-a261-44b5-af7c-bf1d400e3d55'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:53.517442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] The token cache is being invalidate because project 9c0f2a4bac6a48bfa43491b3b977b15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:49:53.517744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:53.518399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b8862b01-a261-44b5-af7c-bf1d400e3d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:49:53.520339 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1118/2202] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:49:53 2021] DELETE /identity/v3/projects/9c0f2a4bac6a48bfa43491b3b977b15f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:53.526284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.526565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.526842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.545463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:53.546659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:53.613520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1085/2203] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:53.624632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.624926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.625208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.649341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:53.650607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:53.661699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1119/2204] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:53.665577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.677880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69fa8f-be76-4310-8130-b684eb70fce0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.682867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.683523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.683827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.684101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.684883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:49:53.685206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.686805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.698345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1086/2205] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:49:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:49:53.702707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.712550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363aa32-d808-436f-b93d-e2d3c1526b13 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.717819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.718480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.718769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.719070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.719812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.721846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.759803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1120/2206] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:49:53 2021] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:53.763976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.775776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18bc0-13ee-49ce-b195-c062469e001d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.857202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.857202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.857202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.857202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.857517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.857517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.879664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1087/2207] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:49:53 2021] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:49:53.883940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.894470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dffa94-fd68-4bf7-9241-fe0f5f272b42 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.899488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.900225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.900492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.900797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.901557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.903159 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.917351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1121/2208] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:53.918624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.929400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453afe-feb9-4f4a-a6d6-d660b45fa406 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.934967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.935660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.936052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.936424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.937210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.938980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21a5a2-f85e-4f15-b1f0-9a9f8ba4f38b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:53.949903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1088/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:49:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:49:53.954615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:53.965087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccdf8d-8272-49ea-85cd-5add05718ca9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:53.970437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:53.971411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:53.971907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:53.972356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] PATH_INFO: `/v3/projects/8c1bd8a5f26c478eb213cf0f65b5ae61/users/ca9582595da34975a0b3657287abcffe/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:53.989957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1bd8a5f26c478eb213cf0f65b5ae61, user_id=ca9582595da34975a0b3657287abcffe, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:53.993245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:54.015157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1122/2210] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:49:53 2021] PUT /identity/v3/projects/8c1bd8a5f26c478eb213cf0f65b5ae61/users/ca9582595da34975a0b3657287abcffe/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:49:54.025873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf810-4f71-406a-8125-1c7df60529e4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:54.026259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf810-4f71-406a-8125-1c7df60529e4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:54.027453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf810-4f71-406a-8125-1c7df60529e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:54.055150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-c8acf810-4f71-406a-8125-1c7df60529e4 None None] MFA Rules not processed for user `ca9582595da34975a0b3657287abcffe`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:49:54.056436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c8acf810-4f71-406a-8125-1c7df60529e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:54.128375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1089/2211] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:49:54 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:49:54.138264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:49:54.140128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:49:54.204017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1736b-4a1a-4dcd-8399-a7c606589135 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:49:54.207902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:49:54.208604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:49:54.208893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:49:54.209181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:49:54.217883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:49:54.219351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f865-d076-4206-9c17-594fb3a26e30 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:49:54.228301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1123/2212] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:49:54 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:05.625019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:05.625594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:05.625816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:05.645829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] MFA Rules not processed for user `22c24beea0b341a7b8d9fa29cc10f6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:05.647208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:05.711934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1090/2213] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:06.384105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38920c-a2c3-4579-93c7-c32736c46b2a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:06.384712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38920c-a2c3-4579-93c7-c32736c46b2a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:06.384808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38920c-a2c3-4579-93c7-c32736c46b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:06.404465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9f38920c-a2c3-4579-93c7-c32736c46b2a None None] MFA Rules not processed for user `9afb7b5b35cb487ba063c7ee7fbcd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:06.405859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9f38920c-a2c3-4579-93c7-c32736c46b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:06.462164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1124/2214] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:16.703523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:16.796112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492406-13a7-4eea-9432-fec62a4c2e45 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:16.801272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:16.802637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:16.803117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:16.803977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] PATH_INFO: `/v3/users/ca9582595da34975a0b3657287abcffe` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:16.808112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9582595da34975a0b3657287abcffe)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:16.811197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:16.891774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9582595da34975a0b3657287abcffe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:16.892517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9582595da34975a0b3657287abcffe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:16.908672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9582595da34975a0b3657287abcffe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:16.918523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9582595da34975a0b3657287abcffe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:16.929984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9582595da34975a0b3657287abcffe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:16.943271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1091/2215] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:16 2021] DELETE /identity/v3/users/ca9582595da34975a0b3657287abcffe => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:16.947910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:16.948468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:16.948468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:16.992440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:16.994051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:17.109739 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1125/2216] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:17.137798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:17.139303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:17.225763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53050c0f-cc22-429a-a7a9-f1e93f4871a6 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:17.229841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:17.230843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:17.231137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:17.231420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:17.242415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:17.244707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1f2bf-df6a-43b5-a153-36349926a04b service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:17.257113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1092/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:17.844618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:17.847172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:17.877930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a018b62-24a4-4a88-9b2b-bf7617144a2d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:17.883481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:17.884571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:17.884857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:17.885133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] PATH_INFO: `/v3/projects/8c1bd8a5f26c478eb213cf0f65b5ae61` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:17.886478 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1bd8a5f26c478eb213cf0f65b5ae61)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:17.888626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:17.947125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1bd8a5f26c478eb213cf0f65b5ae61', 'request_id': 'req-55c7d3bb-776d-4f58-98cf-c03536a703c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:17.953549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1bd8a5f26c478eb213cf0f65b5ae61', 'request_id': 'req-55c7d3bb-776d-4f58-98cf-c03536a703c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:17.960138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1bd8a5f26c478eb213cf0f65b5ae61', 'request_id': 'req-55c7d3bb-776d-4f58-98cf-c03536a703c4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:17.982988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] The token cache is being invalidate because project 8c1bd8a5f26c478eb213cf0f65b5ae61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:17.983284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:17.984176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-55c7d3bb-776d-4f58-98cf-c03536a703c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:17.986405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1126/2218] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:17 2021] DELETE /identity/v3/projects/8c1bd8a5f26c478eb213cf0f65b5ae61 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:17.993029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:17.993791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:17.994207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.022816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:18.024880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:18.112428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1093/2219] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:18.114991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.115344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.115810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.147702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:18.149402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:18.164736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1127/2220] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:18.169724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.186029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cda37-df95-4506-8635-b336f01aefd5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.193536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.194324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.194736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.195031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.196534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:50:18.196892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.198529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.212325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1094/2221] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:50:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:50:18.217761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.228946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaece9-364e-4e76-9dc1-e2f244fc0d87 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.237393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.238246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.238711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.239085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.239950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.245303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.296451 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1128/2222] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:18 2021] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:50:18.298830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.312923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b299-9627-4b5b-891b-f089f010d370 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.369082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.369747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.370056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.370325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.371055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.373047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.399059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1095/2223] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:18 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:18.403199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.414121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12a15-2156-4401-94b0-b97103b6e5b1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.418987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.419701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.419978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.420294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.421042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.422660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.435869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1129/2224] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:18 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:18.440020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.450401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6e70-b962-43fb-a41b-695d573066d4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.455313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.456029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.456345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.456626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.457699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.459473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dcc1a-ef86-4143-8e7d-9763e5f16f32 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.474727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1096/2225] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:18.476197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.488553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9ced8-1481-409f-b92b-480b8ec2f03b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.494231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.495214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.495493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.495755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] PATH_INFO: `/v3/projects/c1554cf6f72d42199fcfe7ce71bac429/users/49c96551c1cd41d5b169ab969fded660/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.514069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1554cf6f72d42199fcfe7ce71bac429, user_id=49c96551c1cd41d5b169ab969fded660, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.516806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.532268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1130/2226] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:18 2021] PUT /identity/v3/projects/c1554cf6f72d42199fcfe7ce71bac429/users/49c96551c1cd41d5b169ab969fded660/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:18.537600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.537898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.538168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.557074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:18.558324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:18.632162 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1097/2227] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:18.642137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:18.644323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:18.702265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806a73-32b8-409d-9eae-89c488e485f4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:18.706242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:18.707009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:18.707430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:18.707708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:18.717306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:18.718747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a93f23-41b7-49e0-a503-85ed8fc2d29e service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:18.728510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1131/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:23.042427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:23.045374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:23.062995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bdffc-4c61-4a0b-abf5-24d751b8be10 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:23.075023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:23.075023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:23.075023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:23.075023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] PATH_INFO: `/v3/users/07a928703caf43d3af6c9951631657b2` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:23.075435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a928703caf43d3af6c9951631657b2)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:23.075435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:23.142613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a928703caf43d3af6c9951631657b2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:23.143980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a928703caf43d3af6c9951631657b2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:23.166305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a928703caf43d3af6c9951631657b2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:23.175065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a928703caf43d3af6c9951631657b2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:23.187154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a928703caf43d3af6c9951631657b2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:23.198399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1098/2229] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:23 2021] DELETE /identity/v3/users/07a928703caf43d3af6c9951631657b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:23.202907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:23.203400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:23.203513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:23.222076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:23.223390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:23.307672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1132/2230] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:23.327450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:23.328971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:23.475499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9559be-5137-40db-97e4-abbff26d7266 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:23.481096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:23.481778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:23.482329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:23.482627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:23.499118 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:23.500662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1ac1d-16bb-4fdc-abe3-75a936bfeb01 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:23.526424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1099/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:23.913177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:23.914676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:23.930428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371adce-02d9-44bc-b74e-f091addc0057 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:23.935796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:23.936961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:23.937394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:23.937810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] PATH_INFO: `/v3/projects/f166e3a54a1241d983397f8518eb37ee` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:23.939655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f166e3a54a1241d983397f8518eb37ee)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:23.943512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.010385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f166e3a54a1241d983397f8518eb37ee', 'request_id': 'req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:24.017320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f166e3a54a1241d983397f8518eb37ee', 'request_id': 'req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:24.024301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f166e3a54a1241d983397f8518eb37ee', 'request_id': 'req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:24.039698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] The token cache is being invalidate because project f166e3a54a1241d983397f8518eb37ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:24.040107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:24.040870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4d93c7b8-f3a4-48b4-b38e-13178b2c3637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:24.042786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1133/2232] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:23 2021] DELETE /identity/v3/projects/f166e3a54a1241d983397f8518eb37ee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:24.049050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.049656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.049820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.069649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:24.070877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:24.161221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1100/2233] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:24.175293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.175293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.175293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.203551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:24.205100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:24.215147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1134/2234] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:24.218988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.239153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecac42e-5f68-4f25-a56e-375a6a4c1dd9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.250600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.251303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.251583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.252036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.253454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:50:24.253808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.255444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.279308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1101/2235] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:50:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:50:24.283928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.299310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bb67d-5e7a-49a7-9055-4b6b7608519c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.312929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.313884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.314987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.315445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.316413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.326109 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.389239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1135/2236] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:50:24.392882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.407079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa6c9a-578b-455e-aa80-251095fd1b47 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.533379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.534316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.535021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.535450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.539020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.542824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.584237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1102/2237] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:24.600042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.611975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf326d1-287c-4dac-a470-eca804ad8730 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.618765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.619464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.619743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.620069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.621135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.622766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb400df-7c48-40ef-9b09-c184f7e9536c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.649616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1136/2238] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:24.653391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.657841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.658136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.658422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.664055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afea20a-790f-46da-bd5d-3c59729cff66 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.669525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.670447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.670898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.671316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.672283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.674922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.703970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1103/2239] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:24 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:24.705079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] MFA Rules not processed for user `49c96551c1cd41d5b169ab969fded660`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:24.705507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.706293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:24.744168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708988-e808-4a20-ad3a-d97f6d16d702 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.763843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.766169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.766569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.767320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] PATH_INFO: `/v3/projects/0f768119a1ad4af1b4c83194b06c3cbd/users/446800c0b738428aac0b6008a9fdb1bb/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.802367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f768119a1ad4af1b4c83194b06c3cbd, user_id=446800c0b738428aac0b6008a9fdb1bb, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.802367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c63d2a-3e14-4518-9dc9-1ccb9b5f93f2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.804618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1137/2240] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:24.809267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.810967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:24.828377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda667e0-edfd-4796-8dd8-0fc602f35903 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:24.840211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1104/2241] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:24 2021] PUT /identity/v3/projects/0f768119a1ad4af1b4c83194b06c3cbd/users/446800c0b738428aac0b6008a9fdb1bb/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:24.848548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.848859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.849145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.896746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] MFA Rules not processed for user `446800c0b738428aac0b6008a9fdb1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:24.898048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:24.898169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:24.898831 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:24.899124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:24.899410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:24.900137 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:24.914052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:24.968899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1138/2242] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:50:24.975127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:24.999770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1105/2243] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:25.000886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.014431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72662a-de30-42a5-938d-d329e37625bd None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.078179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473823f-3372-46b1-a3a4-4f4388bcbb4e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.084521 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.085244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.086421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.086706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.087592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.089810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.099007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.099007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.099007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.099007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.099777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.099777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.122825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1139/2244] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:25.133182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.136235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1106/2245] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:24 2021] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:25.137225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.162046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba305d6-29d5-4ca8-89be-f5fcfa150fd2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.220903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a2d6-0b4e-4c43-bae0-ee447e47da8b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.236384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.237388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.237960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.238376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.239281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.241367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.256393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.257194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.257442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.257732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.258741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.260640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.267288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1107/2246] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:25 2021] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:25.271984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.273809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1140/2247] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:25 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:25.278868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.292714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac847b-8f39-443b-8ec9-95e2643437c1 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.294792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0b5f1-4ef1-4515-a346-1a190d04ab63 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.299724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.300973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.302162 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.302402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.302861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.303671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.304251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.304602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] PATH_INFO: `/v3/projects/8a6ad0e4a41746ed887a54b84546d35a/users/e00cde06cd06427ca62e472ca8c64663/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.304865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.306987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.327467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6ad0e4a41746ed887a54b84546d35a, user_id=e00cde06cd06427ca62e472ca8c64663, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.328563 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1108/2248] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:25 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:25.330926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.331089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.343687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cbc-f9e9-4379-be88-1da1c80c60a8 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.353905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1141/2249] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:25 2021] PUT /identity/v3/projects/8a6ad0e4a41746ed887a54b84546d35a/users/e00cde06cd06427ca62e472ca8c64663/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:25.358382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.433038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.433727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.434004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.434275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.435025 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.436829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.449197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1109/2250] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:25 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:25.453728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.466885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7951-a8bf-46fc-a5f4-db58e6a9efaa admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.473292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b77f90-ca09-43e9-ae32-d39da2632aa4 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.473723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.474623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.474961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.475242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] PATH_INFO: `/v3/projects/907c77e826db4538a265f5034c481630/users/218e2fd909d54427a73764d971611a49/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.491214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.492131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.492665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.493042 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.493956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.495900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.512512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1142/2251] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:25 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:50:25.516759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.516922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907c77e826db4538a265f5034c481630, user_id=218e2fd909d54427a73764d971611a49, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.519625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c315b1b-1162-4601-b923-bfdc853f1013 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.530174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece33ade-33ba-4939-9237-96b9d9efc330 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.535432 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.536527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.537100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.538121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] PATH_INFO: `/v3/projects/8a6ad0e4a41746ed887a54b84546d35a/users/e00cde06cd06427ca62e472ca8c64663/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.541709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6ad0e4a41746ed887a54b84546d35a, user_id=e00cde06cd06427ca62e472ca8c64663, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.545235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.549057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1110/2252] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:25 2021] PUT /identity/v3/projects/907c77e826db4538a265f5034c481630/users/218e2fd909d54427a73764d971611a49/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:25.559240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.559524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.559793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.568954 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1143/2253] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:25 2021] PUT /identity/v3/projects/8a6ad0e4a41746ed887a54b84546d35a/users/e00cde06cd06427ca62e472ca8c64663/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:25.608497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] MFA Rules not processed for user `218e2fd909d54427a73764d971611a49`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:25.609780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:25.728417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1111/2254] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:25.732951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.884873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a948ee-0971-4180-bea8-f9f32f34ebfe admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:25.889981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:25.890660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:25.890943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:25.891209 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:25.892279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:25.893910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:25.939647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1144/2255] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:25 2021] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:25.939805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:25.952406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c626d2-f33d-4443-84b2-e217d3ae1314 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.033522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.034348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.034697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.035103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.035954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.038080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.069967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1112/2256] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:25 2021] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:26.074164 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:26.090539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03bca-fc6c-480a-99d0-2ccb7504eded admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.097952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.099375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.099668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.099941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.101194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.103694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.122642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1145/2257] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:26.123939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:26.137961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe387f2-a064-4fa3-9d0f-fbf47e62d541 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.143778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.145958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.145958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.145958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] PATH_INFO: `/v3/projects/25b6579367b843a893c3f36c7fa8cfb8/users/6406965e66754fc2a43854c210548e30/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.165981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b6579367b843a893c3f36c7fa8cfb8, user_id=6406965e66754fc2a43854c210548e30, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.168961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.188282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1113/2258] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:26 2021] PUT /identity/v3/projects/25b6579367b843a893c3f36c7fa8cfb8/users/6406965e66754fc2a43854c210548e30/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:26.191820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:26.211442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc606-275a-4237-ab6f-023b66715bf3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.283798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.284559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.286016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.286016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.286016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.287922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11683ad-bc7a-4f9b-a2ab-5979da2436d8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.302955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1146/2259] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:26 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:26.304298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:26.320300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aaf54-8356-4454-b660-940f754a30da admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.328837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.330666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.331335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.332052 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] PATH_INFO: `/v3/projects/25b6579367b843a893c3f36c7fa8cfb8/users/6406965e66754fc2a43854c210548e30/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.335036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b6579367b843a893c3f36c7fa8cfb8, user_id=6406965e66754fc2a43854c210548e30, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.339320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.354504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1114/2260] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:26 2021] PUT /identity/v3/projects/25b6579367b843a893c3f36c7fa8cfb8/users/6406965e66754fc2a43854c210548e30/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:26.371134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.371134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.371134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.398418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] MFA Rules not processed for user `6406965e66754fc2a43854c210548e30`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:26.399747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:26.497317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1147/2261] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:26 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:26.509367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:26.513018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:26.578067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c467f-d7b5-411c-9e72-13e8a4213291 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:26.582091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:26.582893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:26.583178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:26.583456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:26.649281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:26.650813 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:26.660398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1115/2262] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:26 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:30.535259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:30.545906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b4a76-9010-4124-9628-8f2bb04dd4ba None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:30.557638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:30.558262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:30.558543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:30.558818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:30.701357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:30.703979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d18c58-2ef1-453c-9efb-350801c73208 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:30.726419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1148/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:30 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:50:31.725719 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:31.739746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f473de-76eb-46f0-b959-2e1e35a2b6a9 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:31.759847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:31.760581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:31.760949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:31.761229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:31.778461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:31.779923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:31.796061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1116/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:31 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:32.304095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2061f-16cc-4aa7-b2bb-5175c6b216ab None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:32.305337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2061f-16cc-4aa7-b2bb-5175c6b216ab None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:32.305805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2061f-16cc-4aa7-b2bb-5175c6b216ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:32.336278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-13d2061f-16cc-4aa7-b2bb-5175c6b216ab None None] MFA Rules not processed for user `e00cde06cd06427ca62e472ca8c64663`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:32.337760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-13d2061f-16cc-4aa7-b2bb-5175c6b216ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:32.417613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1149/2265] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:32 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:32.429445 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:32.430767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:32.524684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e361cad-e81c-4478-b3d0-97cfcc17d6ea service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:32.534717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:32.535401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:32.535691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:32.535964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:32.602860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:32.604530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:32.614974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1117/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:32 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:34.674256 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7889-4332-4cf1-8128-757a748474b2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:34.674764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7889-4332-4cf1-8128-757a748474b2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:34.674844 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7889-4332-4cf1-8128-757a748474b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:34.694402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-047a7889-4332-4cf1-8128-757a748474b2 None None] MFA Rules not processed for user `49c96551c1cd41d5b169ab969fded660`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:34.695792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-047a7889-4332-4cf1-8128-757a748474b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:34.704938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1150/2267] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:34 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:36.431488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:36.433066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:36.512126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21fbd-2675-4a22-8aa4-121219c0e44d service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:36.518355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:36.519480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:36.519963 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:36.520427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] PATH_INFO: `/v3/users/c48e46fa9ef44a30aaab9555ad19769b` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:36.522285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48e46fa9ef44a30aaab9555ad19769b)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:36.524587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:36.586877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48e46fa9ef44a30aaab9555ad19769b'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:36.594705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48e46fa9ef44a30aaab9555ad19769b'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:36.613239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48e46fa9ef44a30aaab9555ad19769b'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:36.626588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48e46fa9ef44a30aaab9555ad19769b'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:36.636079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48e46fa9ef44a30aaab9555ad19769b'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:36.650356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1118/2268] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:36 2021] DELETE /identity/v3/users/c48e46fa9ef44a30aaab9555ad19769b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:36.654604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:36.655083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:36.655176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:36.679751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:36.681050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:36.789904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1151/2269] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:36.799960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:36.802160 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:36.869078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9588ff4-0642-4b4e-aa8d-e1acab444467 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:36.872682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:36.873335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:36.873618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:36.873888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:36.882912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:36.884321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ff762-dd30-4260-86a9-98d6a1f51cd8 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:36.893553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1119/2270] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:36.959363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:36.961027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:36.976966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723dab4-e837-461b-bc03-6878cdaea3ec None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:36.982415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:36.983381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:36.983667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:36.983939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] PATH_INFO: `/v3/users/446800c0b738428aac0b6008a9fdb1bb` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:36.985388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446800c0b738428aac0b6008a9fdb1bb)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:36.987344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.040560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446800c0b738428aac0b6008a9fdb1bb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.041926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446800c0b738428aac0b6008a9fdb1bb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.054356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446800c0b738428aac0b6008a9fdb1bb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.062527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446800c0b738428aac0b6008a9fdb1bb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.064345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446800c0b738428aac0b6008a9fdb1bb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.079340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1152/2271] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:36 2021] DELETE /identity/v3/users/446800c0b738428aac0b6008a9fdb1bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:37.085411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.085692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.085970 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.105697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:37.107042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.176662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1120/2272] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:37.189796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.191410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.204251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.206284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.222628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650b2a-61d6-442e-914d-19b5371110ba None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.228015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.229098 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.230438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.230723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] PATH_INFO: `/v3/projects/319b7997a9f7490f924cc5c223229190` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.233794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=319b7997a9f7490f924cc5c223229190)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.235919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.269444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c4c4e-fab6-422f-98f7-d97ce8051b56 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.274305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.275158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.275557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.276198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.286720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.288545 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf924911-efd2-4011-ab10-4a2c1ee83c87 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.291748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319b7997a9f7490f924cc5c223229190', 'request_id': 'req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.298052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1153/2273] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:37.298179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319b7997a9f7490f924cc5c223229190', 'request_id': 'req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.305447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319b7997a9f7490f924cc5c223229190', 'request_id': 'req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.322010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] The token cache is being invalidate because project 319b7997a9f7490f924cc5c223229190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:37.322300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.323091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0ba8f316-0809-43fa-8bbc-b499fdc7e0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.324774 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1121/2274] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:37 2021] DELETE /identity/v3/projects/319b7997a9f7490f924cc5c223229190 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:37.331037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.331324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.331601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.350853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:37.352087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.416372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1154/2275] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:37.425083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.425368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.425647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.445193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:37.449539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.458483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1122/2276] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:37.463027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.472559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542b17-670c-48fa-9ed4-111a01f087a8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.477697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.478378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.478657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.478932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.480041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:50:37.480411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.482048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.494433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1155/2277] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:50:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:50:37.499001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.511202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c476a7-691f-4660-ae8a-8218ef3762fc None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.522351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.523047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.523335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.523616 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.524661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.526834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.555388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1123/2278] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:37.559760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.569907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7553a47-6da6-4404-aacd-b433fdd524bd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.601740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.605911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.653766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.654072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.654360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.654641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.655382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.657373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.684179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1156/2279] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:37.685589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.691830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f052341-1775-4121-a4f0-1e7d6bfebfae admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.697329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.697660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19f7f8-a312-47c4-be8a-a247857aaa33 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.698358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.698712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.699058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] PATH_INFO: `/v3/projects/0f768119a1ad4af1b4c83194b06c3cbd` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.700756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f768119a1ad4af1b4c83194b06c3cbd)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.703006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.703630 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.704333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.704607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.705116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.705871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.707539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.725815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1157/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:37 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:50:37.738074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.749708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1946-4de7-41ef-af23-32be312071bb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.763233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f768119a1ad4af1b4c83194b06c3cbd', 'request_id': 'req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.770340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f768119a1ad4af1b4c83194b06c3cbd', 'request_id': 'req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.777557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f768119a1ad4af1b4c83194b06c3cbd', 'request_id': 'req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.800935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] The token cache is being invalidate because project 0f768119a1ad4af1b4c83194b06c3cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:37.801229 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.802055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:37.804615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1124/2281] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:37 2021] DELETE /identity/v3/projects/0f768119a1ad4af1b4c83194b06c3cbd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:37.807996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.809933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.830438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.831127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.831413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.831689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.832649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.834414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.859052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1158/2282] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:37 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:37.863973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:37.865913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:37.880769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3df72-0d38-4602-b35e-b9af62644115 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.885749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:37.886929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.887391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.887679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] PATH_INFO: `/v3/projects/1054cf39c28048b6bbf69184baf53491/users/ff5b6ad120f24896a0ca3986294a60e4/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:37.923907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1054cf39c28048b6bbf69184baf53491, user_id=ff5b6ad120f24896a0ca3986294a60e4, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:37.927210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04484cf-7386-4609-8105-343b1b7d0259 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:37.944044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3a583-e20f-4ef9-8fc9-cf6f80758b2c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:37.959461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1159/2283] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:37 2021] PUT /identity/v3/projects/1054cf39c28048b6bbf69184baf53491/users/ff5b6ad120f24896a0ca3986294a60e4/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:37.965305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:37.965662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:37.966282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.013890 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] MFA Rules not processed for user `ff5b6ad120f24896a0ca3986294a60e4`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:38.015529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.024058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.025192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.025478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.025754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] PATH_INFO: `/v3/users/218e2fd909d54427a73764d971611a49` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.027106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218e2fd909d54427a73764d971611a49)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.029301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.107841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218e2fd909d54427a73764d971611a49'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.110420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218e2fd909d54427a73764d971611a49'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.111754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1160/2284] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:37 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:38.124695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:38.125741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218e2fd909d54427a73764d971611a49'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.131004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.133891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218e2fd909d54427a73764d971611a49'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.143821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218e2fd909d54427a73764d971611a49'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.152216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1125/2285] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:37 2021] DELETE /identity/v3/users/218e2fd909d54427a73764d971611a49 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:38.208915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67c08-7d4c-40dc-b3f4-85d653ac2b42 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:38.269494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.270160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.270441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.270715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.272695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.373824 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.375402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.385887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1161/2286] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:38 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:50:38.413371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:38.414860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.490378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c1b3a-6442-48dc-a46a-5a44c02038e5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:38.495464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.496454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.496745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.497024 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] PATH_INFO: `/v3/users/ff5b6ad120f24896a0ca3986294a60e4` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.498368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5b6ad120f24896a0ca3986294a60e4)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.500328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.530342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:38.531873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.551664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c515-9ff7-4103-a46d-d713ce849512 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:38.561345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.562951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.563781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.564357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] PATH_INFO: `/v3/projects/907c77e826db4538a265f5034c481630` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.566428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] RBAC: Authorizing `identity:delete_project(project_id=907c77e826db4538a265f5034c481630)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.569258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.603570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5b6ad120f24896a0ca3986294a60e4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.604356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5b6ad120f24896a0ca3986294a60e4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.620239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5b6ad120f24896a0ca3986294a60e4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.636144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5b6ad120f24896a0ca3986294a60e4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.650087 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9509b0a2-e6ed-4464-a1bf-ae15899cf3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5b6ad120f24896a0ca3986294a60e4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.657031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1126/2287] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:38 2021] DELETE /identity/v3/users/ff5b6ad120f24896a0ca3986294a60e4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:38.666779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.667375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.667863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.676856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907c77e826db4538a265f5034c481630', 'request_id': 'req-35fe9933-d1be-4944-89da-6677876d051e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.684663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907c77e826db4538a265f5034c481630', 'request_id': 'req-35fe9933-d1be-4944-89da-6677876d051e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.691655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907c77e826db4538a265f5034c481630', 'request_id': 'req-35fe9933-d1be-4944-89da-6677876d051e'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.700301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:38.701797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.716624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] The token cache is being invalidate because project 907c77e826db4538a265f5034c481630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:38.717065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.717926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.719877 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1162/2288] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:38 2021] DELETE /identity/v3/projects/907c77e826db4538a265f5034c481630 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:38.724312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:38.726402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.808433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1127/2289] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:38.814901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9933-d1be-4944-89da-6677876d051e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:38.819847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.821124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.821405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.821681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] PATH_INFO: `/v3/users/6406965e66754fc2a43854c210548e30` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.822452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:38.822936 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6406965e66754fc2a43854c210548e30)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.827669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.827859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.916219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82d0f-2e08-4030-b64f-8ee15cdeadfe None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:38.925040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:38.925731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:38.925913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6406965e66754fc2a43854c210548e30'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.926026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:38.926305 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:38.927052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6406965e66754fc2a43854c210548e30'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.928900 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:38.944392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:38.946033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:38.956625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6406965e66754fc2a43854c210548e30'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.958207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1128/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:50:38.967236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6406965e66754fc2a43854c210548e30'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.968095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6406965e66754fc2a43854c210548e30'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:38.982929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1163/2291] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:38 2021] DELETE /identity/v3/users/6406965e66754fc2a43854c210548e30 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:50:39.312002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:39.313849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:39.339063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1c906-c1c6-478d-9e41-9b9d3abbd0e5 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:39.421409 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:39.422892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:39.433433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:39.434479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.434855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.435387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] PATH_INFO: `/v3/projects/1054cf39c28048b6bbf69184baf53491` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.436775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1054cf39c28048b6bbf69184baf53491)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:39.439178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:39.509295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1054cf39c28048b6bbf69184baf53491', 'request_id': 'req-e9a43469-67d8-44a4-9f32-a42e652b0006'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.514977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03006f-2ab1-4d11-b2fc-94ea37039b78 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:39.517374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1054cf39c28048b6bbf69184baf53491', 'request_id': 'req-e9a43469-67d8-44a4-9f32-a42e652b0006'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.524599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1054cf39c28048b6bbf69184baf53491', 'request_id': 'req-e9a43469-67d8-44a4-9f32-a42e652b0006'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.545754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] The token cache is being invalidate because project 1054cf39c28048b6bbf69184baf53491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:39.546526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.547370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e9a43469-67d8-44a4-9f32-a42e652b0006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.560393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1129/2292] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:39 2021] DELETE /identity/v3/projects/1054cf39c28048b6bbf69184baf53491 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:39.608232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:39.609136 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.609415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.609685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] PATH_INFO: `/v3/projects/25b6579367b843a893c3f36c7fa8cfb8` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.611173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b6579367b843a893c3f36c7fa8cfb8)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:39.613842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:39.682717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b6579367b843a893c3f36c7fa8cfb8', 'request_id': 'req-6ea9fd9d-62b2-4b26-a843-f50579e00b69'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.689605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b6579367b843a893c3f36c7fa8cfb8', 'request_id': 'req-6ea9fd9d-62b2-4b26-a843-f50579e00b69'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.695955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b6579367b843a893c3f36c7fa8cfb8', 'request_id': 'req-6ea9fd9d-62b2-4b26-a843-f50579e00b69'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.716122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] The token cache is being invalidate because project 25b6579367b843a893c3f36c7fa8cfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:39.716449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.717133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-6ea9fd9d-62b2-4b26-a843-f50579e00b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:39.718794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1164/2293] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:39 2021] DELETE /identity/v3/projects/25b6579367b843a893c3f36c7fa8cfb8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:39.724767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.725051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.725321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.746716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:39.748042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:39.820805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1130/2294] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:39.822635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.822857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.824646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.845604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:39.846828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:39.855381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1165/2295] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:50:39.859879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:39.871049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6d991-3e10-4576-ae90-89a938fd8ef1 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:39.875869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:39.876897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.877179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.877461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.878578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:50:39.878894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:39.880629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:39.893377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1131/2296] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:50:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:50:39.898781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:39.908166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802582f-4a67-4462-81bc-1961b3db9769 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:39.913606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:39.914269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:39.914547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:39.914817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:39.915786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:39.917907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:39.964798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1166/2297] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:39 2021] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:39.969434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:39.981271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608740d4-8027-4c57-a003-8830ffa5962b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:40.052676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:40.053372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.053685 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.053934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.054712 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:40.056687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:40.078814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1132/2298] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:39 2021] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:40.082180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:40.092819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387be20-122e-4ebf-9008-1e449c7d4120 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:40.097639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:40.098340 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.098624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.098931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.099812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:40.101473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:40.112997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1167/2299] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:40.117379 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:40.128378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d8b03-f8e8-4a9f-9a79-974f517e47f0 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:40.133336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:40.134048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.134330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.134604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.135350 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:40.137010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197edc48-9281-45b2-850e-596617823ad3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:40.147015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1133/2300] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:50:40.151317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:40.161772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4befa-c008-4c21-a104-5977aba443fb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:40.167407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:40.168327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.168613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.170388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] PATH_INFO: `/v3/projects/51016618bea441a097212c84d2361558/users/52eeb56803b341208de4aa1b9385eb55/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.186653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51016618bea441a097212c84d2361558, user_id=52eeb56803b341208de4aa1b9385eb55, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:40.189337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:40.206438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1168/2301] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:40 2021] PUT /identity/v3/projects/51016618bea441a097212c84d2361558/users/52eeb56803b341208de4aa1b9385eb55/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:40.218738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7dbe-0305-4487-a8c1-ae7effe07040 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.219096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7dbe-0305-4487-a8c1-ae7effe07040 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.219290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7dbe-0305-4487-a8c1-ae7effe07040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.246481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-bf2f7dbe-0305-4487-a8c1-ae7effe07040 None None] MFA Rules not processed for user `52eeb56803b341208de4aa1b9385eb55`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:40.247941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bf2f7dbe-0305-4487-a8c1-ae7effe07040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:40.327188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1134/2302] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:40.340015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:40.345539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:40.411418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037f55-f96b-40f2-ace9-44f273ecb5d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:40.416556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:40.417255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:40.417614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:40.417888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:40.429746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:40.434145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:40.444381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1169/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:40 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:46.275373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:46.275835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:46.276003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:46.294528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:46.295750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:46.352922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1135/2304] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:50:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:46.403750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:46.405301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:46.477926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18f056-bee3-4450-a666-75c422758652 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:46.484181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:46.484767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:46.485072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:46.485347 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:46.495672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:46.497437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae221630-6eb1-42f8-bd04-902fce4e17cc service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:46.505919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1170/2305] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:50:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:50:53.189368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:53.331798 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f953-f83b-402f-bc86-c62d68057a34 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:53.340452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:53.341145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:53.341145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:53.341506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] PATH_INFO: `/v3/users/52eeb56803b341208de4aa1b9385eb55` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:53.342802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52eeb56803b341208de4aa1b9385eb55)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:53.346854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:53.416140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52eeb56803b341208de4aa1b9385eb55'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:53.417088 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52eeb56803b341208de4aa1b9385eb55'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:53.436494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52eeb56803b341208de4aa1b9385eb55'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:53.443784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52eeb56803b341208de4aa1b9385eb55'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:53.453976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52eeb56803b341208de4aa1b9385eb55'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:53.461125 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1136/2306] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:50:53 2021] DELETE /identity/v3/users/52eeb56803b341208de4aa1b9385eb55 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:53.467313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:53.467901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:53.467901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:53.497573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:53.500860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:53.643695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1171/2307] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:53.658937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:53.661042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:53.749110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79b97-0716-43c1-bf9c-b017d10d4bd5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:53.754195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:53.754961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:53.755347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:53.755729 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:53.766543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:53.769497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50151-b16a-427e-8d06-e08e33714907 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:53.783008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1137/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:54.097532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.099106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:54.119631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa431c8-7fd9-41e5-80be-844531a901db None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.124803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.125776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.126048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.126324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] PATH_INFO: `/v3/projects/51016618bea441a097212c84d2361558` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.127539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51016618bea441a097212c84d2361558)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.129853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.186013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51016618bea441a097212c84d2361558', 'request_id': 'req-2624b81f-60a1-4506-a3e8-f7505939ca40'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:54.192978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51016618bea441a097212c84d2361558', 'request_id': 'req-2624b81f-60a1-4506-a3e8-f7505939ca40'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:54.199226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51016618bea441a097212c84d2361558', 'request_id': 'req-2624b81f-60a1-4506-a3e8-f7505939ca40'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:54.216867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] The token cache is being invalidate because project 51016618bea441a097212c84d2361558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:50:54.217495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:54.218661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2624b81f-60a1-4506-a3e8-f7505939ca40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:50:54.220498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1172/2309] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:50:54 2021] DELETE /identity/v3/projects/51016618bea441a097212c84d2361558 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:54.228284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.228846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.228846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.249395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:54.251517 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:54.358810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1138/2310] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:54.367683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.367973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.368635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.394956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:54.396502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:54.406854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1173/2311] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:54.411261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.434573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7656f42-175b-4933-bf22-61ee101b33a2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.441571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.443100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.443403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.443686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.444873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:50:54.445376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.448238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.465539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1139/2312] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:50:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:50:54.467005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.477562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0144b-4fc6-4a78-ba3d-a8e803a0948d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.496356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.497135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.497481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.497819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.498732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.500806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.537655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1174/2313] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:50:54 2021] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:54.542758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.553497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774b94-c10e-4832-9d99-add73264cd5b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.628057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.628973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.629424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.629644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.630485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.634337 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.670414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1140/2314] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:50:54 2021] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:50:54.671914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.683244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598661b-bc60-462d-a48d-1c4579b9d91a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.689419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.691128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.691412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.691686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.692463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.694231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.709319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1175/2315] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:50:54.710659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.724421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf894-f8c4-4299-a83f-6da20be2a923 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.731179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.732709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.733408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.734184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.734724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.736592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494bbf2-858e-48ae-9569-636bf32e51d5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.751302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1141/2316] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:50:54 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:50:54.761314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:54.778519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff193c-2c2d-4951-bb5f-467502dd4ca3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:54.788290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:54.789368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.789764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.790196 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] PATH_INFO: `/v3/projects/c5e3b4fa99ed478cadc86a6adbcba214/users/03d752ef66824af1920c201923719944/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.811713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e3b4fa99ed478cadc86a6adbcba214, user_id=03d752ef66824af1920c201923719944, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:54.814550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:54.833891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1176/2317] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:50:54 2021] PUT /identity/v3/projects/c5e3b4fa99ed478cadc86a6adbcba214/users/03d752ef66824af1920c201923719944/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:50:54.839519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a886-f471-49aa-b653-7b0e586b7236 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:54.839817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a886-f471-49aa-b653-7b0e586b7236 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:54.840097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a886-f471-49aa-b653-7b0e586b7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:54.893440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fc72a886-f471-49aa-b653-7b0e586b7236 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:54.895221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fc72a886-f471-49aa-b653-7b0e586b7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:55.032693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1142/2318] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:50:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:55.044293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:55.046652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:55.181716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873d5ee-461f-4905-a69a-370ad38b6600 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:55.186271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:55.188093 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:55.188415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:55.188694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:55.201531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:55.203509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:55.216866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1177/2319] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:50:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:50:58.857375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b32ea-8038-4667-bb21-af28204b0ef7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:58.858046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b32ea-8038-4667-bb21-af28204b0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:58.858046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b32ea-8038-4667-bb21-af28204b0ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:58.879315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-299b32ea-8038-4667-bb21-af28204b0ef7 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:50:58.882457 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-299b32ea-8038-4667-bb21-af28204b0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:58.977651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1143/2320] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:50:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:50:58.996862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:50:58.998333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:50:59.141173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd8d9f-8a28-4f16-9bc0-5605b354f5fc service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:50:59.163214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:50:59.163938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:50:59.164259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:50:59.164539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:50:59.174989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:50:59.176770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:50:59.186297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1178/2321] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:50:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:51:05.032015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:05.033140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:05.033684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:05.137997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] MFA Rules not processed for user `03d752ef66824af1920c201923719944`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:05.139275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:05.338844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1144/2322] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:05.343229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:05.451546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4d6bf-0206-4337-a090-84422a4fd182 service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:05.463716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:05.467673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:05.468174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:05.469506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:05.479865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:05.486446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:05.637124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1179/2323] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:05 2021] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:05.640917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:05.655059 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7d813-bd50-4455-bffa-11e9798dd9b1 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:05.774808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:05.775520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:05.775807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:05.776089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:05.776849 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:05.778817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:05.860320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1145/2324] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:05 2021] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:05.864684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:05.878510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a6d0b-5606-4f44-ab85-db712d6decd9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:05.895874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:05.899929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:05.900466 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:05.901107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:05.903434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:05.909174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:05.952546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:05.965237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1180/2325] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:05 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:05.968267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b091f30-cc53-4bbe-aa70-b21884f62705 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:05.986717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:05.987977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:05.989475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:05.990942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] PATH_INFO: `/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46/users/fb0f5811560a4e55b87630c21a7f1550/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:06.028243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc4ae157b8644179b3ffec5cc9cca46, user_id=fb0f5811560a4e55b87630c21a7f1550, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:06.034410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:06.060919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1146/2326] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:05 2021] PUT /identity/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46/users/fb0f5811560a4e55b87630c21a7f1550/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:06.065481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:06.083359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049904d8-4cb8-489c-98eb-4dea5df1a23d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:06.222911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:06.224063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:06.224574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:06.224990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:06.229396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:06.229396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:06.255210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1181/2327] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:06.260235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:06.273702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e9a14-0369-4273-aac2-f53d3a517e2c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:06.287765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:06.292362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:06.292882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:06.294838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] PATH_INFO: `/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46/users/fb0f5811560a4e55b87630c21a7f1550/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:06.309864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc4ae157b8644179b3ffec5cc9cca46, user_id=fb0f5811560a4e55b87630c21a7f1550, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:06.314817 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:06.392641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1147/2328] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:06 2021] PUT /identity/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46/users/fb0f5811560a4e55b87630c21a7f1550/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:14.239897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:14.242710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:14.266539 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8434-78f0-4134-9050-b2ddb41d6d0b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:14.395101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:14.396590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:14.397116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:14.397608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] PATH_INFO: `/v3/users/9afb7b5b35cb487ba063c7ee7fbcd4fd` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:14.399193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb7b5b35cb487ba063c7ee7fbcd4fd)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:14.401490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:14.495291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb7b5b35cb487ba063c7ee7fbcd4fd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:14.498810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb7b5b35cb487ba063c7ee7fbcd4fd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:14.525039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb7b5b35cb487ba063c7ee7fbcd4fd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:14.541349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb7b5b35cb487ba063c7ee7fbcd4fd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:14.542582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-b6b601d5-c895-4364-8255-9fcac440b2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb7b5b35cb487ba063c7ee7fbcd4fd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:14.583707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1182/2329] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:14 2021] DELETE /identity/v3/users/9afb7b5b35cb487ba063c7ee7fbcd4fd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:15.333137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:15.335176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:15.368394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837ef3-144c-4eee-a94b-60130c0ac9b7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:15.575060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:15.575993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:15.576310 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:15.576592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] PATH_INFO: `/v3/projects/b78f91fa9da147eda471e50cc9684f97` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:15.597740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78f91fa9da147eda471e50cc9684f97)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:15.602361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:15.763820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78f91fa9da147eda471e50cc9684f97', 'request_id': 'req-dd5b0b43-597b-4156-8cc7-e34750c10501'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:15.873503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78f91fa9da147eda471e50cc9684f97', 'request_id': 'req-dd5b0b43-597b-4156-8cc7-e34750c10501'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:15.893679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78f91fa9da147eda471e50cc9684f97', 'request_id': 'req-dd5b0b43-597b-4156-8cc7-e34750c10501'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:15.951632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] The token cache is being invalidate because project b78f91fa9da147eda471e50cc9684f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:15.952022 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:15.964252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-dd5b0b43-597b-4156-8cc7-e34750c10501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:15.964252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1148/2330] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:15 2021] DELETE /identity/v3/projects/b78f91fa9da147eda471e50cc9684f97 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:15.964839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:15.965683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:15.966101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.196859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:16.198445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:16.368851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1183/2331] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:16.372961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:16.373933 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:16.374357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.422873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:16.426343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:16.468054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1149/2332] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:16.471746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:16.490642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e72f5-76e0-4b89-89ce-fd0eccd332bc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:16.510278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:16.513920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:16.514491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:16.516418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.517492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:51:16.518306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:16.546658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:16.590581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1184/2333] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:51:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:51:16.594768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:16.624770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176d40-344a-4f69-9d36-728df1066889 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:16.642993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:16.652351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:16.653099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:16.653615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.654784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:16.656783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:16.710884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1150/2334] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:16 2021] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:16.711850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:16.724070 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0691-6505-4b87-9f8c-238141d137d9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:16.859631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:16.860371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:16.860657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:16.860935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.861697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:16.879183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:16.947968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1185/2335] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:16 2021] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:16.949222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:16.966355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0747-85dc-4ed9-b92c-ca143232e2c9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:16.979287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:16.981651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:16.982194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:16.983165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:16.984231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:16.992031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:17.018006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1151/2336] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:16 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:17.022806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:17.062246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d440d-1086-4c0c-b8f6-227f255a8336 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:17.079559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:17.080310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:17.080600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:17.081747 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:17.088403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:17.090737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1499cc5-ed69-4bfe-8ec6-54d837ad361d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:17.126828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1186/2337] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:17.132097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:17.149051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6507c-7e72-40c1-807f-d65ef62d5e64 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:17.166784 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:17.167996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:17.168545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:17.168995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] PATH_INFO: `/v3/projects/8ea6421c43d24cf0b6146435a50a917e/users/07b07c9a557645db8dea2d7a7c9d91d0/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:17.197548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea6421c43d24cf0b6146435a50a917e, user_id=07b07c9a557645db8dea2d7a7c9d91d0, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:17.201473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:17.232452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1152/2338] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:17 2021] PUT /identity/v3/projects/8ea6421c43d24cf0b6146435a50a917e/users/07b07c9a557645db8dea2d7a7c9d91d0/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:17.252395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:17.253293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:17.253723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:17.322223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] MFA Rules not processed for user `07b07c9a557645db8dea2d7a7c9d91d0`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:17.323513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:17.508614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1187/2339] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:17 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:17.511280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:17.664106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc6c6-4e01-4db3-b5d3-dae99dc769ce admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:17.669866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:17.670917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:17.671308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:17.671925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:17.672663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:17.674972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:17.723581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1153/2340] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:17 2021] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:17.724483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:17.746638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed9f9-93cf-4492-baf5-5acf55e09d16 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:17.897676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:17.898604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:17.899126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:17.899437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:17.900248 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:17.902199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:17.959536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1188/2341] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:17 2021] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:51:17.961213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:18.010470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b91e0a-51af-4425-889c-2c4069142a6d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:18.016254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:18.017163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.017733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.018478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.022752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:18.024915 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:18.042865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:18.043477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1154/2342] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:18.072370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892802c-6bfe-4dd8-80fa-a73b1263efc5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:18.095554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:18.096598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.096880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.097328 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] PATH_INFO: `/v3/projects/6745775acf4a409885270b9d2346ae88/users/79c8e093677e4318bdc7ea09242e3f03/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.149667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6745775acf4a409885270b9d2346ae88, user_id=79c8e093677e4318bdc7ea09242e3f03, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:18.162369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:18.188135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1189/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:18 2021] PUT /identity/v3/projects/6745775acf4a409885270b9d2346ae88/users/79c8e093677e4318bdc7ea09242e3f03/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:18.195743 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:18.217400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6e40f-38de-440e-bdcd-aeedec2f2c9b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:18.364215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:18.365091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.365577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.366005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.366922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:18.369372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c8a8-145c-4fe4-b679-ddfbafe2a4c1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:18.405748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:18.412132 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1155/2344] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:18 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:18.418169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95596b-d6d2-4f7e-b5d0-e42a37d45758 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:18.423788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:18.425714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.426226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.426673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] PATH_INFO: `/v3/projects/6745775acf4a409885270b9d2346ae88/users/79c8e093677e4318bdc7ea09242e3f03/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.430230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6745775acf4a409885270b9d2346ae88, user_id=79c8e093677e4318bdc7ea09242e3f03, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:18.433468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:18.480172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1190/2345] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:18 2021] PUT /identity/v3/projects/6745775acf4a409885270b9d2346ae88/users/79c8e093677e4318bdc7ea09242e3f03/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:18.490642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.491425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.491425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.531005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] MFA Rules not processed for user `79c8e093677e4318bdc7ea09242e3f03`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:18.534386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:18.618458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1156/2346] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:18 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:18.629628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:18.631350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:18.739709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949fdcf-fe2a-4b28-9998-05bd060ad15b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:18.744669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:18.745481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:18.745830 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:18.746163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:18.756873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:18.759391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0e491-f4ba-4bd1-86e7-47a3b9de626d service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:18.772016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1191/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:18 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:19.016326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:19.092492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb24fd-143f-4531-b1be-ab94657bda96 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:19.096983 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:19.097862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:19.098339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:19.098613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] PATH_INFO: `/v3/users/07b07c9a557645db8dea2d7a7c9d91d0` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:19.099985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b07c9a557645db8dea2d7a7c9d91d0)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:19.101993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:19.162006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b07c9a557645db8dea2d7a7c9d91d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:19.162699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b07c9a557645db8dea2d7a7c9d91d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:19.177688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b07c9a557645db8dea2d7a7c9d91d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:19.185716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b07c9a557645db8dea2d7a7c9d91d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:19.195020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b07c9a557645db8dea2d7a7c9d91d0'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:19.205138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1157/2348] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:19 2021] DELETE /identity/v3/users/07b07c9a557645db8dea2d7a7c9d91d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:19.207099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd644-a9d5-4483-ab2d-a9947d5bebb7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:19.207566 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd644-a9d5-4483-ab2d-a9947d5bebb7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:19.207783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd644-a9d5-4483-ab2d-a9947d5bebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:19.225055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7f7cd644-a9d5-4483-ab2d-a9947d5bebb7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:19.226370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7f7cd644-a9d5-4483-ab2d-a9947d5bebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:19.290113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1192/2349] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:19.298149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:19.299992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:19.419681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c03d7-45c9-4329-ace7-d33fd654f1a5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:19.429800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:19.430533 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:19.431003 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:19.431287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:19.453341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:19.454821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:19.471554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1158/2350] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:19.706274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:19.706565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:19.706849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:19.768846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] MFA Rules not processed for user `fb0f5811560a4e55b87630c21a7f1550`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:19.770099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:19.887750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1193/2351] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:19 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:19.906153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:19.908092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:19.936403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:19.938198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:19.957943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539cb08-6bb9-49de-ab3c-8bae9fa9a0fe None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:19.963532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:19.964867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:19.965302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:19.965753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] PATH_INFO: `/v3/projects/8ea6421c43d24cf0b6146435a50a917e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:19.967327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea6421c43d24cf0b6146435a50a917e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:19.970169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:20.015549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b257b-2ba9-45b0-b0a7-818a1f6f3f04 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:20.025040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:20.025742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.026026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.026295 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.030122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.053090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea6421c43d24cf0b6146435a50a917e', 'request_id': 'req-2e3751c7-83a2-4d6b-993a-0818224e1859'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.059754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea6421c43d24cf0b6146435a50a917e', 'request_id': 'req-2e3751c7-83a2-4d6b-993a-0818224e1859'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.065441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea6421c43d24cf0b6146435a50a917e', 'request_id': 'req-2e3751c7-83a2-4d6b-993a-0818224e1859'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.086934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] The token cache is being invalidate because project 8ea6421c43d24cf0b6146435a50a917e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:20.087529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.088585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.090270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1194/2352] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:19 2021] DELETE /identity/v3/projects/8ea6421c43d24cf0b6146435a50a917e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:20.094645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:20.096804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.101756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:20.103700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381925e-39e4-476c-8c38-650b520af56f service glance] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:20.117403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1159/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:19 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:20.118752 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97294-2ea6-4e94-ad80-95cb2839b8e6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.119422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97294-2ea6-4e94-ad80-95cb2839b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.119828 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97294-2ea6-4e94-ad80-95cb2839b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.141706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-92a97294-2ea6-4e94-ad80-95cb2839b8e6 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:20.143073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-92a97294-2ea6-4e94-ad80-95cb2839b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.197399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3751c7-83a2-4d6b-993a-0818224e1859 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:20.210656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:20.213678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.213970 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.214245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] PATH_INFO: `/v3/users/79c8e093677e4318bdc7ea09242e3f03` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.216437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c8e093677e4318bdc7ea09242e3f03)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:20.219291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:20.229371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1160/2354] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:51:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:20.241791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.242196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.242674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.262899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:20.264135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.271655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1161/2355] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:51:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:20.272326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:20.273555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.276355 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c8e093677e4318bdc7ea09242e3f03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.277083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c8e093677e4318bdc7ea09242e3f03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.304057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c8e093677e4318bdc7ea09242e3f03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.315396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c8e093677e4318bdc7ea09242e3f03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.316647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c8e093677e4318bdc7ea09242e3f03'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:20.345573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1195/2356] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:20 2021] DELETE /identity/v3/users/79c8e093677e4318bdc7ea09242e3f03 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:20.346186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:20.347695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.409603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fc67-a1fe-4bad-be87-cb6af9bb528f None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:20.483663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a30e-a697-4afb-b744-7745d27a412f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:20.496823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:20.497497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.497781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.498054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.501359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.508491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:20.509161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:20.509444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:20.510656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:20.517923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:20.606408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:20.608750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:20.627405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1196/2357] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:51:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:51:20.656547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:20.658652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554fff6-91c3-4a86-a098-0e5859645073 service swift] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:20.675650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1162/2358] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:51:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:51:21.043353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:21.045053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:21.255118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b957912-bec2-4fb3-91f3-8c38f74a7c9d service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:21.267961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:21.269006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:21.269364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:21.269669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] PATH_INFO: `/v3/projects/6745775acf4a409885270b9d2346ae88` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:21.274086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6745775acf4a409885270b9d2346ae88)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:21.276267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:21.396462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6745775acf4a409885270b9d2346ae88', 'request_id': 'req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:21.407589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6745775acf4a409885270b9d2346ae88', 'request_id': 'req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:21.419174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6745775acf4a409885270b9d2346ae88', 'request_id': 'req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:21.479527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] The token cache is being invalidate because project 6745775acf4a409885270b9d2346ae88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:21.480125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:21.489789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e3fd9670-6fa5-49bc-a094-0db9077ea0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:21.504654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1197/2359] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:21 2021] DELETE /identity/v3/projects/6745775acf4a409885270b9d2346ae88 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:21.505731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:21.506156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:21.506286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:21.563528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:21.570780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:21.712969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1163/2360] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:21.720798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:21.721135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:21.721415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:21.760918 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:21.762989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:21.795746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:21.807167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1198/2361] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:21.818735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b2718-cc85-4ca9-ab5c-735dffef4a59 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:21.832855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:21.833767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:21.834336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:21.835018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:21.836224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:51:21.836636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:21.846226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:21.894406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1164/2362] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:51:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:51:21.900585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:21.911832 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887ed1-ca35-4174-a34d-c4f1134b8c67 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:21.930420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:21.934570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:21.934870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:21.935157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:21.935929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:21.945515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.041662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1199/2363] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:21 2021] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:22.042290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.062529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11235a-1be1-49ac-ba9a-91f19afab53c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:22.261137 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:22.262167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.262697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.263182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.264205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:22.266522 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.294629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1165/2364] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:22 2021] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:22.298601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.311985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d687-5b8a-4798-95f6-d8cef375436a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:22.338186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:22.346511 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.347492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.348103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.349775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:22.374788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.395719 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1200/2365] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:22.396602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.410443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747d0d3-7334-4ce6-8592-84db4c748128 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:22.418803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:22.419884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.420479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.420959 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.421995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:22.423993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a1da4-632e-457f-8501-0ce3452ffb54 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.451436 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1166/2366] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:22.452693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.471978 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783e1a7-b347-4abf-a4de-9b13f37f7092 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:22.477422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:22.478675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.478986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.479241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] PATH_INFO: `/v3/projects/9242f10aceb84de589702eb8c858baf4/users/21c1a3925591433ab7c723759e8e4696/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.499945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9242f10aceb84de589702eb8c858baf4, user_id=21c1a3925591433ab7c723759e8e4696, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:22.502995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.552013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1201/2367] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:22 2021] PUT /identity/v3/projects/9242f10aceb84de589702eb8c858baf4/users/21c1a3925591433ab7c723759e8e4696/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:22.553844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.554324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.554413 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.598111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] MFA Rules not processed for user `21c1a3925591433ab7c723759e8e4696`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:22.599311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:22.767922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1167/2368] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:22 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:22.772102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.873006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363f13-64d7-4a6b-a6a2-acedf4240301 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:22.878821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:22.879670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:22.880053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:22.880480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:22.881369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:22.883533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:22.919935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1202/2369] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:22 2021] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:51:22.923714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:22.936699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0709bb9-65ad-4083-91e3-df74aca528a7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.030448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.031405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.031851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.032507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.033405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.035550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.064642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1168/2370] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:22 2021] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:23.076426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:23.092774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d02a1-32b8-4ec3-8110-227c915cf5a7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.104216 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.105726 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.106028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.106369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.107222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.109554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.127146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1203/2371] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:23.131049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:23.145245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26706062-bb43-4f34-9e23-e4c6feb650eb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.158027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.159186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.159561 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.159985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] PATH_INFO: `/v3/projects/2dab300f857c4961b8a5d05aa460d885/users/af4637227f4644739829a0f8c098af3a/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.191830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dab300f857c4961b8a5d05aa460d885, user_id=af4637227f4644739829a0f8c098af3a, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.194940 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.225701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1169/2372] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:23 2021] PUT /identity/v3/projects/2dab300f857c4961b8a5d05aa460d885/users/af4637227f4644739829a0f8c098af3a/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:23.232177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:23.254876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97096c-2f53-4073-8e2b-c2cb8f4a745a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.359417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.360232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.360610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.360977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.361838 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.369285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40b1b-46a5-4ba6-8ee6-d14b8230ed96 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.390356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1204/2373] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:23 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:23.394390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:23.407980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad618f-0152-41b6-9656-f16baa084b95 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.422883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.424115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.424428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.424703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] PATH_INFO: `/v3/projects/2dab300f857c4961b8a5d05aa460d885/users/af4637227f4644739829a0f8c098af3a/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.436126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dab300f857c4961b8a5d05aa460d885, user_id=af4637227f4644739829a0f8c098af3a, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.438884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.461783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1170/2374] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:23 2021] PUT /identity/v3/projects/2dab300f857c4961b8a5d05aa460d885/users/af4637227f4644739829a0f8c098af3a/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:23.472061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.472391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.472676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.543028 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] MFA Rules not processed for user `af4637227f4644739829a0f8c098af3a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:23.548321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:23.705463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1205/2375] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:23 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:23.712758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:23.714531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:23.881803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876c4d-b9c0-442c-a04d-a41c799a579f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:23.888850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:23.889644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:23.889991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:23.890336 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:23.902753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:23.909629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec2bb-669d-4a27-b2eb-31b83492c5e5 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:23.928000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1171/2376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:23 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:24.325555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:24.485122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f57f5a-3233-425f-8cd0-d097a63a9e64 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:24.497994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:24.499017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:24.501384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:24.501715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] PATH_INFO: `/v3/users/21c1a3925591433ab7c723759e8e4696` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:24.506463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c1a3925591433ab7c723759e8e4696)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:24.514745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:24.614284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c1a3925591433ab7c723759e8e4696'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:24.615614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c1a3925591433ab7c723759e8e4696'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:24.630674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c1a3925591433ab7c723759e8e4696'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:24.657571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c1a3925591433ab7c723759e8e4696'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:24.658202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c1a3925591433ab7c723759e8e4696'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:24.687879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1206/2377] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:24 2021] DELETE /identity/v3/users/21c1a3925591433ab7c723759e8e4696 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:24.688810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:24.689093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:24.689364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:24.734080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:24.736283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:24.969122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1172/2378] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:25.015282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:25.018702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:25.189754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692869ea-18c9-4128-b68e-2f6df756d0f7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:25.199576 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:25.200177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:25.200459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:25.200737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:25.224455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:25.226075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:25.256171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1207/2379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:25.525994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:25.527965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:25.545278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a2f32-a3f2-4a5f-b63c-21e68de87e87 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:25.559417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:25.564984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:25.564984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:25.564984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] PATH_INFO: `/v3/users/22c24beea0b341a7b8d9fa29cc10f6a4` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:25.573280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c24beea0b341a7b8d9fa29cc10f6a4)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:25.575287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:25.671683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:25.673249 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:25.713534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c24beea0b341a7b8d9fa29cc10f6a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:25.714500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c24beea0b341a7b8d9fa29cc10f6a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:25.736636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c24beea0b341a7b8d9fa29cc10f6a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:25.747086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c24beea0b341a7b8d9fa29cc10f6a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:25.762576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c24beea0b341a7b8d9fa29cc10f6a4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:25.772609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1173/2380] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:25 2021] DELETE /identity/v3/users/22c24beea0b341a7b8d9fa29cc10f6a4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:25.892369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f992-8099-4aca-a634-afb2c631c90f service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:25.988408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:25.988962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.061540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:26.062374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.062672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.062927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.065087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.079015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:26.080950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a89a1-1498-42c4-bbb8-bc3b55ba7c11 service placement] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:26.094030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1208/2381] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:26.095865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69754-5c2a-4c46-b5ab-4813f17502a1 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.096418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69754-5c2a-4c46-b5ab-4813f17502a1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.096921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69754-5c2a-4c46-b5ab-4813f17502a1 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.098846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1209/2382] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:51:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:51:26.107331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.107991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.108507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.145546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19fc90-b599-4166-ab43-b828a1f984c2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:26.159485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:26.160835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.161338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.161853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] PATH_INFO: `/v3/projects/9242f10aceb84de589702eb8c858baf4` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.164255 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9242f10aceb84de589702eb8c858baf4)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:26.166571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:26.188268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:26.189699 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.273697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9242f10aceb84de589702eb8c858baf4', 'request_id': 'req-0f5f1a49-f75c-4c64-aaa8-f6d637098898'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.287010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9242f10aceb84de589702eb8c858baf4', 'request_id': 'req-0f5f1a49-f75c-4c64-aaa8-f6d637098898'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.294925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9242f10aceb84de589702eb8c858baf4', 'request_id': 'req-0f5f1a49-f75c-4c64-aaa8-f6d637098898'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.303013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1210/2383] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:51:26 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:26.316172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] The token cache is being invalidate because project 9242f10aceb84de589702eb8c858baf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:26.316520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.317233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.320481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1174/2384] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:25 2021] DELETE /identity/v3/projects/9242f10aceb84de589702eb8c858baf4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:26.321150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:26.323066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.323328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:26.325021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.460711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a6265-c809-4bbc-94f0-aff0ff29fca6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:26.463105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f1a49-f75c-4c64-aaa8-f6d637098898 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:26.469303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:26.470216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.470490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.470769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] PATH_INFO: `/v3/users/af4637227f4644739829a0f8c098af3a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.472069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4637227f4644739829a0f8c098af3a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:26.478642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:26.607284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:26.608014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.608476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.608842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.610601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4637227f4644739829a0f8c098af3a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.611620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4637227f4644739829a0f8c098af3a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.616646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.660841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4637227f4644739829a0f8c098af3a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.672885 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4637227f4644739829a0f8c098af3a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.695965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4637227f4644739829a0f8c098af3a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.704786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1175/2385] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:26 2021] DELETE /identity/v3/users/af4637227f4644739829a0f8c098af3a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:26.706045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:26.707671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.770392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:26.772073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ae7b2-601e-4940-ba07-3c87915c59fe service glance] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:26.791699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472055d4-8fbd-49a7-a32d-2ac4d227561f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:26.797050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:26.798235 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.798718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.799148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] PATH_INFO: `/v3/projects/f589a625d7db445091f6729e449426e9` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.800791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f589a625d7db445091f6729e449426e9)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:26.803053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:26.805245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1211/2386] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:26.872392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f589a625d7db445091f6729e449426e9', 'request_id': 'req-54cc5f5e-726e-47b1-99b5-695a514a5f61'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.885615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f589a625d7db445091f6729e449426e9', 'request_id': 'req-54cc5f5e-726e-47b1-99b5-695a514a5f61'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.893610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f589a625d7db445091f6729e449426e9', 'request_id': 'req-54cc5f5e-726e-47b1-99b5-695a514a5f61'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.900373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985187ac-574e-47fc-8556-f48c9896c612 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.901480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985187ac-574e-47fc-8556-f48c9896c612 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.902017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985187ac-574e-47fc-8556-f48c9896c612 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.904022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1212/2387] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:51:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:51:26.916088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.916300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.916608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.930390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] The token cache is being invalidate because project f589a625d7db445091f6729e449426e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:26.930794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.933458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-54cc5f5e-726e-47b1-99b5-695a514a5f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:26.938834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1176/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:26 2021] DELETE /identity/v3/projects/f589a625d7db445091f6729e449426e9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:26.944666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55370e-e4f9-4951-9345-ae66ae354677 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:26.944992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55370e-e4f9-4951-9345-ae66ae354677 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:26.945617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55370e-e4f9-4951-9345-ae66ae354677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:26.950387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:26.953792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:26.970684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ac55370e-e4f9-4951-9345-ae66ae354677 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:26.971919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ac55370e-e4f9-4951-9345-ae66ae354677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.043356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1213/2389] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:51:26 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:27.060692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1177/2390] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:27.060929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.062969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.077656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106b50-b082-4b6b-ab75-5995f24dae30 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.077905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.078091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.078371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.083200 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.084103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.084558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.084914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.094515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.096582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.100072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:27.101769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.114073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1214/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:51:27.120604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1178/2392] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:27.128884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.143635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354ff0-85be-4836-8b66-50ef54cfb567 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.151239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.152238 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.152784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.153231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.154165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:51:27.154564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.156317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.199364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.216270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1215/2393] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:51:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:51:27.219506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ee2f-22e3-4ab6-8f53-fb1668168ded None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.225824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.226920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.226920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.227124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.227902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.230261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.303051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1179/2394] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:27.304742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.315705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3eec54-1df9-40c1-9951-dd76fc7ccd4f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.323327 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.325149 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.450215 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a37b-5087-48ff-beff-3877697b3dc3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.459612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.460547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.460882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.461155 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] PATH_INFO: `/v3/projects/2dab300f857c4961b8a5d05aa460d885` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.462755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dab300f857c4961b8a5d05aa460d885)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.464722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.495644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.496645 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.496777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.496981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.497779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.505571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.555688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1216/2395] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:27.556674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.589934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6cc03-594a-4d23-9e08-1ba462c04fa3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.594532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dab300f857c4961b8a5d05aa460d885', 'request_id': 'req-65964f75-43d6-4fa7-ae49-801c7ba52c9f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:27.618727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dab300f857c4961b8a5d05aa460d885', 'request_id': 'req-65964f75-43d6-4fa7-ae49-801c7ba52c9f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:27.633996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dab300f857c4961b8a5d05aa460d885', 'request_id': 'req-65964f75-43d6-4fa7-ae49-801c7ba52c9f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:27.671765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] The token cache is being invalidate because project 2dab300f857c4961b8a5d05aa460d885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:27.672058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:27.672901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-65964f75-43d6-4fa7-ae49-801c7ba52c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:27.691868 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1180/2396] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:27 2021] DELETE /identity/v3/projects/2dab300f857c4961b8a5d05aa460d885 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:27.693570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d01b7-e0e2-44da-b254-a54e0afe7e49 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.695684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d01b7-e0e2-44da-b254-a54e0afe7e49 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.695684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d01b7-e0e2-44da-b254-a54e0afe7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.718289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.719727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.719727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.719727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.720367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.723031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.735316 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1217/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:27 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:27.739036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a50d01b7-e0e2-44da-b254-a54e0afe7e49 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:27.739974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.740709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a50d01b7-e0e2-44da-b254-a54e0afe7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.741860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.755991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1074b-ba4e-4bda-a1d6-6c4cfc91c998 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.762859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1181/2398] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:27.770939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.771233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.771519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.776321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.777003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.777285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.777561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.778304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.782427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.801891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1218/2399] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:27 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:27.803146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.813357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:27.814673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c48cc-7b7e-4a0e-ad27-e26da2264380 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.815264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.819795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.820896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.821183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.821462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] PATH_INFO: `/v3/projects/3b4463a1337940a4a17c0d54bb402c3a/users/6d70e8cff3fd447ab85e4c1ffc5281ef/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.838994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1182/2400] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:27.839208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4463a1337940a4a17c0d54bb402c3a, user_id=6d70e8cff3fd447ab85e4c1ffc5281ef, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.842147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66727-6bb8-4f28-a2e6-b662c94ceabc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:27.843089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:27.854924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a04e2-cdf0-49b3-8537-af293c5f50c0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:27.861638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1219/2401] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:27 2021] PUT /identity/v3/projects/3b4463a1337940a4a17c0d54bb402c3a/users/6d70e8cff3fd447ab85e4c1ffc5281ef/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:27.875932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.876502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.876692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.933595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] MFA Rules not processed for user `6d70e8cff3fd447ab85e4c1ffc5281ef`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:27.936798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:27.990591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:27.991904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:27.993157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:27.993604 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:27.994390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:51:27.994704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:27.996439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.012651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1183/2402] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:51:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:51:28.018452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.032635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87332-93a8-4fc0-a4ac-0e9b6abaf6ad admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.038747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.039728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.040171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.051796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.057348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.061860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.111073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1220/2403] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:27 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:28.114353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1184/2404] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:28 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:28.118323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.128824 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.136283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:28.146371 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3cb92-f7db-4103-a7c8-e1f7ac559565 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.265020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b0a3c-a04f-459b-9a5e-290c1f3338a5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.270357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.271079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.271365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.274962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.350517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.350990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.351336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.351920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.352843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.355893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.404437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1221/2405] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:28 2021] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:28.410287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.429418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c924661-38a9-4c29-9171-f26f8918de66 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.444816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.445775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.446245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.446615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.447709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.451734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.465845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.467657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.469326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1222/2406] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:28 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:28.473145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.487127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ffa28-f9ec-40f8-ba50-bde05b801ac2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.493842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1185/2407] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:28 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:28.498212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.500516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.500870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.501160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.501940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.503530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12efa01-902b-4d5e-9d85-0fa4f349cf6e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.537768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1223/2408] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:28 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:51:28.540799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.555039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499d5a-23f4-410e-bd52-b21087f66c41 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.568806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.568806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.568806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.568806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] PATH_INFO: `/v3/projects/15510ba80cf14261a2a0cf6cc7114834/users/84e52a4c37f2493b8abb0916bdad6c06/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.586045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=15510ba80cf14261a2a0cf6cc7114834, user_id=84e52a4c37f2493b8abb0916bdad6c06, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.591932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.616496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1186/2409] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:28 2021] PUT /identity/v3/projects/15510ba80cf14261a2a0cf6cc7114834/users/84e52a4c37f2493b8abb0916bdad6c06/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:28.628270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.628858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.629452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.678621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] MFA Rules not processed for user `84e52a4c37f2493b8abb0916bdad6c06`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:28.680201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:28.779748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1224/2410] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:28 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:28.784921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.882259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b9f8a-500e-45a7-994c-307825a82c9d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:28.891328 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:28.892113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:28.892502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:28.892855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:28.893643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:28.896609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:28.934851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1187/2411] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:28 2021] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:28.938595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:28.959494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb02ee-edba-4d71-8202-45f9f77a0e49 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:29.118716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:29.120675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.120675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.120675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.121293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:29.123724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:29.169609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1225/2412] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:28 2021] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:29.170412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:29.183461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422cd55-4a48-4025-8d39-59284e6cb077 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:29.201096 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:29.202086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.202557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.203019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.204177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:29.206468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:29.239342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1188/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:29.244122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:29.260871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed35d1-3563-4ccd-95db-94f70f9a7c32 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:29.275068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:29.276679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.277014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.277295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] PATH_INFO: `/v3/projects/03fe9123b91043d4afb4e51b477d2a72/users/19584a97a9ab42f4916d95040db5ae96/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.302633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fe9123b91043d4afb4e51b477d2a72, user_id=19584a97a9ab42f4916d95040db5ae96, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:29.308089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:29.332986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1226/2414] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:29 2021] PUT /identity/v3/projects/03fe9123b91043d4afb4e51b477d2a72/users/19584a97a9ab42f4916d95040db5ae96/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:29.338690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:29.379159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b59da-3c5b-4d3a-9a3b-59569f70f60b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:29.563568 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:29.569148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.570147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.574156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.577800 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:29.588769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7f61-03f3-48bc-ad3c-b536efbae086 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:29.654682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1189/2415] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:29.657277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:29.687312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb14bb-6025-4180-8397-274b2cf7d507 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:29.721039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:29.721994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.722358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.723265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] PATH_INFO: `/v3/projects/03fe9123b91043d4afb4e51b477d2a72/users/19584a97a9ab42f4916d95040db5ae96/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.732362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fe9123b91043d4afb4e51b477d2a72, user_id=19584a97a9ab42f4916d95040db5ae96, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:29.737988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:29.778447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1227/2416] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:29 2021] PUT /identity/v3/projects/03fe9123b91043d4afb4e51b477d2a72/users/19584a97a9ab42f4916d95040db5ae96/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:51:29.802196 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174f2c-ee87-4a52-99cc-076b9ed86aee None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:29.803875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174f2c-ee87-4a52-99cc-076b9ed86aee None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:29.804785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174f2c-ee87-4a52-99cc-076b9ed86aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:29.858206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-a8174f2c-ee87-4a52-99cc-076b9ed86aee None None] MFA Rules not processed for user `19584a97a9ab42f4916d95040db5ae96`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:29.859707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a8174f2c-ee87-4a52-99cc-076b9ed86aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:29.961115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1190/2417] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:29 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:29.974123 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:29.977579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:30.112501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4952f-3cac-4608-8a0d-7812d2510f07 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:30.116721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:30.118069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:30.118514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:30.118940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:30.149221 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:30.153969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:30.174676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1228/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:29 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:30.367352 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:30.368171 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:30.368583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:30.372292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:30.399061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7f6d-0527-4253-a30e-6a1e0fb07b7e service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:30.409283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:30.409973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:30.410253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:30.410527 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:30.431202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] MFA Rules not processed for user `6d70e8cff3fd447ab85e4c1ffc5281ef`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:30.434748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:30.488826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:30.490319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6b1cc-1324-4ce0-baa0-a2ba53d4afdb service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:30.514463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1229/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:30 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:30.554283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1191/2420] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:31.861395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:31.862488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:31.863172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:31.894861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:31.896271 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:32.038458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1230/2421] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:51:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:32.070377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:32.075239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:32.180844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb52d-afa4-483a-98ef-8f256a7cb01b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:32.186751 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:32.187666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:32.188184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:32.188775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:32.200032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:32.201748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba05ae-8117-43ad-a419-820da343879a service swift] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:32.211134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1192/2422] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:51:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:51:33.859064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:34.014605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f8c1e-743a-4b74-8ae4-fad04123255e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:34.028670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:34.029956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:34.030412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:34.030863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] PATH_INFO: `/v3/users/84e52a4c37f2493b8abb0916bdad6c06` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:34.037996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e52a4c37f2493b8abb0916bdad6c06)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:34.040426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:34.171863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e52a4c37f2493b8abb0916bdad6c06'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:34.173247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e52a4c37f2493b8abb0916bdad6c06'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:34.202147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e52a4c37f2493b8abb0916bdad6c06'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:34.216691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e52a4c37f2493b8abb0916bdad6c06'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:34.217669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e52a4c37f2493b8abb0916bdad6c06'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:34.243812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1231/2423] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:33 2021] DELETE /identity/v3/users/84e52a4c37f2493b8abb0916bdad6c06 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:34.300930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:34.306089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:34.308810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:34.365826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:34.367585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:34.453965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1193/2424] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:34.474762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:34.476418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:34.562015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff9101-19b3-40fb-b54c-3d2b15c8170f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:34.571081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:34.572453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:34.572453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:34.572744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:34.583435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:34.586850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:34.610107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1232/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:35.224663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:35.226675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:35.249566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2a55-78dc-434c-b0d6-cbbb771c3c6a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:35.269559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:35.270655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:35.271041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:35.271456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] PATH_INFO: `/v3/projects/15510ba80cf14261a2a0cf6cc7114834` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:35.273514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15510ba80cf14261a2a0cf6cc7114834)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:35.275972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:35.376128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15510ba80cf14261a2a0cf6cc7114834', 'request_id': 'req-797dd255-0a0d-4aee-960a-52f8d92c4ec2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.390733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15510ba80cf14261a2a0cf6cc7114834', 'request_id': 'req-797dd255-0a0d-4aee-960a-52f8d92c4ec2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.404676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15510ba80cf14261a2a0cf6cc7114834', 'request_id': 'req-797dd255-0a0d-4aee-960a-52f8d92c4ec2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.429095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] The token cache is being invalidate because project 15510ba80cf14261a2a0cf6cc7114834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:35.429995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.431386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.438873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:35.449618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1194/2426] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:35 2021] DELETE /identity/v3/projects/15510ba80cf14261a2a0cf6cc7114834 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:35.455113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d004-9ca7-46fd-b46e-20bc9c045ad6 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:35.634634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:35.635469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:35.635753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:35.636012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] PATH_INFO: `/v3/users/19584a97a9ab42f4916d95040db5ae96` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:35.637406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19584a97a9ab42f4916d95040db5ae96)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:35.639387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:35.786140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19584a97a9ab42f4916d95040db5ae96'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.786881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19584a97a9ab42f4916d95040db5ae96'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.823390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19584a97a9ab42f4916d95040db5ae96'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.837981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19584a97a9ab42f4916d95040db5ae96'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.839467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-213d80a6-d526-4523-9425-553dda8f4844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19584a97a9ab42f4916d95040db5ae96'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:35.874453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1233/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:51:35 2021] DELETE /identity/v3/users/19584a97a9ab42f4916d95040db5ae96 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:36.666740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:36.668872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:36.699448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd255-0a0d-4aee-960a-52f8d92c4ec2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:36.778389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:36.780389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:36.781054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:36.781653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] PATH_INFO: `/v3/projects/03fe9123b91043d4afb4e51b477d2a72` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:36.783195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fe9123b91043d4afb4e51b477d2a72)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:36.787793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:36.896011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fe9123b91043d4afb4e51b477d2a72', 'request_id': 'req-8978acae-05d8-4b75-982f-3bff53d89fdd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:36.915292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fe9123b91043d4afb4e51b477d2a72', 'request_id': 'req-8978acae-05d8-4b75-982f-3bff53d89fdd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:36.930102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fe9123b91043d4afb4e51b477d2a72', 'request_id': 'req-8978acae-05d8-4b75-982f-3bff53d89fdd'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:36.968259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] The token cache is being invalidate because project 03fe9123b91043d4afb4e51b477d2a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:51:36.972117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:36.972402 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8978acae-05d8-4b75-982f-3bff53d89fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:51:36.974936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1195/2428] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:51:36 2021] DELETE /identity/v3/projects/03fe9123b91043d4afb4e51b477d2a72 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:36.983262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:36.983898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:36.983898 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.007043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:37.008326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:37.092933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1234/2429] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:37.094006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.094575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.095041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.118815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:37.120673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:37.134921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1196/2430] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:37.137422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.158761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c822b-3a3b-49ca-8a9c-30be87a1df25 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.164413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.165101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.165438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.165655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.166509 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:51:37.166973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.168756 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.191282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1235/2431] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:51:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:51:37.192773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.208284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef04ab-c83b-4b13-bd0c-fa40f2b5d135 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.214636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.215815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.216374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.216816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.233062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.235567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.299863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1197/2432] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:37 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:37.304839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.317010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b73b36-587d-41e7-ba77-4d656a78f43e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.488486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.489342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.489612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.489886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.490853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.496809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.571596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.571713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1236/2433] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:37 2021] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:51:37.584760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d30bf-f514-4483-9e64-8ff12283e958 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.609677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.610574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.610942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.611279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.612247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.614174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.627238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1198/2434] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:37 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:37.631484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.641895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f88f28-d223-4fb2-b6e2-1228fdb1048a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.649171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.649853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.650227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.650500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.651413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.653161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18255-c4fd-45bc-a888-908a06ca36d4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.664759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1237/2435] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:37.669015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.681177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4ffcc-c985-42d0-982c-d1ab1d2f7d84 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.686545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.687605 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.687966 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.688288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] PATH_INFO: `/v3/projects/b3d6fb52b8de455a96f677e5a9f80078/users/e31477cfe84c4321b292608928b35027/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.712243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d6fb52b8de455a96f677e5a9f80078, user_id=e31477cfe84c4321b292608928b35027, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.715097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:37.729878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1199/2436] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:37 2021] PUT /identity/v3/projects/b3d6fb52b8de455a96f677e5a9f80078/users/e31477cfe84c4321b292608928b35027/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:37.740546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.740851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.741129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.771081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] MFA Rules not processed for user `e31477cfe84c4321b292608928b35027`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:37.772336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:37.888556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1238/2437] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:37.892787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:37.970785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba2e99-f5a3-480f-b328-602b9dcdf569 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:37.975967 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:37.977112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:37.977473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:37.977754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:37.978841 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:37.981008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.011384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1200/2438] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:51:37 2021] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:51:38.014998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.026508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e69d56-986e-4e30-b8c9-59ede24cbca1 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.082872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.083574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.083866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.084144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.084902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.086867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.108001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1239/2439] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:51:38 2021] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:51:38.112284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.122567 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec3d2-4034-415f-9ff1-5cd89778c3c9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.127214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.127879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.128177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.128467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.129214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.130827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.141631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1201/2440] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:38 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:38.145983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.156618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b59b7c-165f-4a70-9b70-4031fbb4a11b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.162365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.163264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.163546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.163886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] PATH_INFO: `/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c/users/4dcc0f5f167d472584e6b836c62dbda1/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.179214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f7381fadc4b9fa0145aa1a9f80c3c, user_id=4dcc0f5f167d472584e6b836c62dbda1, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.181931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.200463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1240/2441] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:38 2021] PUT /identity/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c/users/4dcc0f5f167d472584e6b836c62dbda1/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:38.204592 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.215485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414750-8c9c-49e3-b712-aa1f3815bc7d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.286239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.287153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.287496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.287853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.288879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.291478 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdff771-a222-431e-b8a4-47bef6a86145 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.302639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1202/2442] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:51:38 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:51:38.307372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.318250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35790e4e-4c6c-4a98-b7e7-d8d70adb0c7e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.323564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.324481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.324765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.325041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] PATH_INFO: `/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c/users/4dcc0f5f167d472584e6b836c62dbda1/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.327467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f7381fadc4b9fa0145aa1a9f80c3c, user_id=4dcc0f5f167d472584e6b836c62dbda1, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.330504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.344002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1241/2443] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:51:38 2021] PUT /identity/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c/users/4dcc0f5f167d472584e6b836c62dbda1/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:51:38.354894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac296d-08bf-4847-b73a-c2521755b4e1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.355207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac296d-08bf-4847-b73a-c2521755b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.355486 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac296d-08bf-4847-b73a-c2521755b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.383875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-80ac296d-08bf-4847-b73a-c2521755b4e1 None None] MFA Rules not processed for user `4dcc0f5f167d472584e6b836c62dbda1`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:38.385198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-80ac296d-08bf-4847-b73a-c2521755b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:38.453547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1203/2444] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:38 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:38.466624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:38.468654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:38.543827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f995-bcee-4b44-90c6-cab39bd92d4c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:38.549548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:38.550314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:38.550660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:38.551013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:38.613227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:38.614677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:38.625705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1242/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:39.081325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8f0d-bd37-4f41-b710-6468b1e351ab None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:39.082319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8f0d-bd37-4f41-b710-6468b1e351ab None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:39.082845 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8f0d-bd37-4f41-b710-6468b1e351ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:39.117500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-33bd8f0d-bd37-4f41-b710-6468b1e351ab None None] MFA Rules not processed for user `03d752ef66824af1920c201923719944`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:39.119155 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-33bd8f0d-bd37-4f41-b710-6468b1e351ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:39.188649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1204/2446] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:51:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:51:44.545791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:44.547424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:44.585026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f243-d8ce-4727-9c4d-bd38143d16ae service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:44.589658 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:44.590318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:44.590601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:44.590876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:44.601405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:44.603450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:44.618900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1243/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:51:44 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:51:48.958648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:48.959597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:48.960086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:48.979318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:51:48.980721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:49.077949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1205/2448] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:51:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:51:49.108816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:51:49.110791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:51:49.224643 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598d288-6554-4767-b1fa-cde7c6ed16b8 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:51:49.231294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:51:49.231734 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:51:49.232131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:51:49.232443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:51:49.243526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:51:49.245288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:51:49.256302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1244/2449] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:51:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 25 04:52:06.941097 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:06.942803 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:07.004669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e525-736b-480b-9b29-68d51ba3183c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:07.008206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:07.008858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:07.009138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:07.009410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:07.011252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:07.082758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:07.084233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b457-d605-4596-9ebb-f207c50a7e1b service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:07.095535 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1206/2450] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:06 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:09.944479 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:10.016985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:10.017507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:10.017507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:10.038005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667e7e6-86d7-431a-863c-0762ad848eef service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:10.042633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:10.043520 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:10.043803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:10.044078 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] PATH_INFO: `/v3/users/e31477cfe84c4321b292608928b35027` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:10.045476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31477cfe84c4321b292608928b35027)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:10.047351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:10.069538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:10.071005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:10.091942 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1207/2451] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:52:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:10.109442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:10.122075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31477cfe84c4321b292608928b35027'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:10.123142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31477cfe84c4321b292608928b35027'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:10.137385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31477cfe84c4321b292608928b35027'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:10.147772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31477cfe84c4321b292608928b35027'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:10.148716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-92472d74-7f14-482d-87c9-bc69bbcd09be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31477cfe84c4321b292608928b35027'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:10.152994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2c9ab-500a-473c-8af1-b10bf82f3bd8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:10.162329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:10.163355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:10.163735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:10.164251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:10.166615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:10.187074 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:10.189345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:10.193691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1245/2452] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:09 2021] DELETE /identity/v3/users/e31477cfe84c4321b292608928b35027 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:10.198546 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:10.198839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:10.199119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:10.205634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1208/2453] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:52:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:52:10.242156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:10.243413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:10.384383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1246/2454] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:10.420597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:10.422211 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:10.449706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a6e6-831b-40ec-b52e-f4ae1e5fe5c4 service swift] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:10.541203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:10.541884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:10.542179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:10.542490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:10.553694 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:10.556046 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:10.573596 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1209/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:11.231215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:11.232952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:11.245987 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890f92-63b3-4009-a35e-c9d5db88b33d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:11.251170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:11.252038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:11.252349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:11.252791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] PATH_INFO: `/v3/projects/b3d6fb52b8de455a96f677e5a9f80078` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:11.254001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d6fb52b8de455a96f677e5a9f80078)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:11.256040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:11.303548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d6fb52b8de455a96f677e5a9f80078', 'request_id': 'req-adacc338-6422-41b7-a73d-04b22d8a0b1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.309486 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d6fb52b8de455a96f677e5a9f80078', 'request_id': 'req-adacc338-6422-41b7-a73d-04b22d8a0b1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.315173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d6fb52b8de455a96f677e5a9f80078', 'request_id': 'req-adacc338-6422-41b7-a73d-04b22d8a0b1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.331617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] The token cache is being invalidate because project b3d6fb52b8de455a96f677e5a9f80078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:11.331948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.332727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.334593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1247/2456] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:11 2021] DELETE /identity/v3/projects/b3d6fb52b8de455a96f677e5a9f80078 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:11.339503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:11.350117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8d892-c601-4fb5-bf7e-fb20ae4f8202 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:11.411877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:11.412871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:11.413148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:11.413422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] PATH_INFO: `/v3/users/4dcc0f5f167d472584e6b836c62dbda1` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:11.414641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dcc0f5f167d472584e6b836c62dbda1)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:11.416588 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:11.464943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dcc0f5f167d472584e6b836c62dbda1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.465577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dcc0f5f167d472584e6b836c62dbda1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.477977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dcc0f5f167d472584e6b836c62dbda1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.485141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dcc0f5f167d472584e6b836c62dbda1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.494276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-662119f1-ab4e-4eef-b0d9-5bbf0369b5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dcc0f5f167d472584e6b836c62dbda1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.500949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1210/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:11 2021] DELETE /identity/v3/users/4dcc0f5f167d472584e6b836c62dbda1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:11.804139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:11.805755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:11.822229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacc338-6422-41b7-a73d-04b22d8a0b1c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:11.883810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:11.884840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:11.885118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:11.885418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] PATH_INFO: `/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:11.886663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818f7381fadc4b9fa0145aa1a9f80c3c)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:11.888742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:11.937565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818f7381fadc4b9fa0145aa1a9f80c3c', 'request_id': 'req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.944378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818f7381fadc4b9fa0145aa1a9f80c3c', 'request_id': 'req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.950226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818f7381fadc4b9fa0145aa1a9f80c3c', 'request_id': 'req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.967039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] The token cache is being invalidate because project 818f7381fadc4b9fa0145aa1a9f80c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:11.967352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.967984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-3d11a9c1-3c8b-4732-b2b1-0b8a9982f8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:11.969870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1248/2458] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:11 2021] DELETE /identity/v3/projects/818f7381fadc4b9fa0145aa1a9f80c3c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:11.976127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:11.976383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:11.976667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.003015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:12.004706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:12.081531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1211/2459] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:12.089372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.089661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.089938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.109358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:12.110590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:12.119383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1249/2460] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:12.123934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.135655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddfecc-2b00-4bde-be03-60b3b525b40c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.141470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.142183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.142459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.142733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.143648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:52:12.143969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.145650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.158207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1212/2461] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:52:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:52:12.162718 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.172440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cb8fc-ed91-4013-a2be-625bacf324eb None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.177464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.178245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.178597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.178953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.179751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.181928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.213687 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1250/2462] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:12.218130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.229055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498b41-2193-43e7-bb76-897e89beff52 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.292525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.293230 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.293520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.293794 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.294582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.296905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.319326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1213/2463] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:12.323467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.334119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458117e9-9e3d-4bbc-900b-4736889d1f3f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.339387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.340081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.340405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.340684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.341477 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.343107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.356061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1251/2464] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:52:12.360818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.371594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd7971-43b2-4c0a-9dd2-a1fb577c075c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.376545 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.377214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.377500 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.377792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.378589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.380257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b3442-c2d5-4d70-98dd-d94dc16853e5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.399594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1214/2465] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:12.399733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.409368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574768-1a3b-48e3-b50f-84d0349413f1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.414090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.415009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.415287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.415560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] PATH_INFO: `/v3/projects/efc4f1ab91d84dd3ba924b535aa9fbd3/users/5514b02c7603448ca0a22199a594a07b/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.430288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc4f1ab91d84dd3ba924b535aa9fbd3, user_id=5514b02c7603448ca0a22199a594a07b, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.433686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.451707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1252/2466] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:12 2021] PUT /identity/v3/projects/efc4f1ab91d84dd3ba924b535aa9fbd3/users/5514b02c7603448ca0a22199a594a07b/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:12.463271 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.463593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.463874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.497073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] MFA Rules not processed for user `5514b02c7603448ca0a22199a594a07b`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:12.499083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:12.569860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1215/2467] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:12.575160 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.649873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b2a4e-cc2d-4e56-a68f-d36227d63556 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.657301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.658151 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.658435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.658727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.659762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.662407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.697452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1253/2468] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:12.701985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.713408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05753-4947-4c72-8ba8-1f547adf151d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.771113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.771728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.772008 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.772308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.773034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.774938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.797780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1216/2469] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:12 2021] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:12.802935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.813957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9aec-01db-4e03-9f4c-5e3170603813 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.819415 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.820110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.820429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.820706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.821455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.823094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.835464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1254/2470] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:12.839634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.850468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7d9d5-b527-402f-a798-d21f7f3a4795 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.856484 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.857430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.857710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.857982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] PATH_INFO: `/v3/projects/006dcf372ccf468aa8adfaaa9e854df8/users/58f29c0b20be4ae69d11ec02553a2361/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.876474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006dcf372ccf468aa8adfaaa9e854df8, user_id=58f29c0b20be4ae69d11ec02553a2361, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.879163 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.894202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1217/2471] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:12 2021] PUT /identity/v3/projects/006dcf372ccf468aa8adfaaa9e854df8/users/58f29c0b20be4ae69d11ec02553a2361/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:12.898051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.911968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8eb3c-2105-4ad2-b3e6-cdd9b3a8c1ad admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:12.968012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:12.968733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:12.969015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:12.969290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:12.970053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:12.971616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a844bf-638f-4898-ae75-9894f755636e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:12.981607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1255/2472] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:12.986157 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:12.996821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7eb9-6442-463f-895c-f4816b3d6089 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:13.001962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:13.003072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:13.003376 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:13.003642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] PATH_INFO: `/v3/projects/006dcf372ccf468aa8adfaaa9e854df8/users/58f29c0b20be4ae69d11ec02553a2361/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:13.005674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006dcf372ccf468aa8adfaaa9e854df8, user_id=58f29c0b20be4ae69d11ec02553a2361, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:13.008414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:13.020504 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1218/2473] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:12 2021] PUT /identity/v3/projects/006dcf372ccf468aa8adfaaa9e854df8/users/58f29c0b20be4ae69d11ec02553a2361/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:13.034139 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:13.034691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:13.034969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:13.064097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] MFA Rules not processed for user `58f29c0b20be4ae69d11ec02553a2361`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:13.065455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:13.133041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1256/2474] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:13 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:13.143582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:13.145974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:13.204037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588213a7-0a3c-4fe0-8697-15e73a16db55 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:13.207896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:13.208576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:13.208853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:13.209124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:13.218150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:13.219547 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66a159-fc67-42a1-97c4-fcd817c594dc service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:13.229099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1219/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:13 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:14.006087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:14.071927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e388e-bf81-47e5-9000-c6f1976b35c2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:14.076944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:14.077869 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:14.078278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:14.078562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] PATH_INFO: `/v3/users/5514b02c7603448ca0a22199a594a07b` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:14.079816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5514b02c7603448ca0a22199a594a07b)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:14.081823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:14.129571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5514b02c7603448ca0a22199a594a07b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.130314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5514b02c7603448ca0a22199a594a07b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.143901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5514b02c7603448ca0a22199a594a07b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.152029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5514b02c7603448ca0a22199a594a07b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.152872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5514b02c7603448ca0a22199a594a07b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.166073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1257/2476] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:14 2021] DELETE /identity/v3/users/5514b02c7603448ca0a22199a594a07b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:14.170865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:14.171344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:14.171438 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:14.189283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:14.190471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:14.251170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1220/2477] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:14.261626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:14.263183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:14.320636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e245-d689-4f86-95f2-7a86995f4b7f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:14.324668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:14.325341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:14.325631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:14.325947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:14.336177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:14.337874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:14.348559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1258/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:52:14.715624 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:14.717290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:14.730231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0dbb82-687b-41cc-9faa-8cc95118907a None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:14.736728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:14.737717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:14.738068 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:14.738410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] PATH_INFO: `/v3/projects/efc4f1ab91d84dd3ba924b535aa9fbd3` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:14.739799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc4f1ab91d84dd3ba924b535aa9fbd3)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:14.741839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:14.792117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc4f1ab91d84dd3ba924b535aa9fbd3', 'request_id': 'req-58fd7a31-8059-47c9-bfed-4b13a20188ad'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.798357 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc4f1ab91d84dd3ba924b535aa9fbd3', 'request_id': 'req-58fd7a31-8059-47c9-bfed-4b13a20188ad'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.804981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc4f1ab91d84dd3ba924b535aa9fbd3', 'request_id': 'req-58fd7a31-8059-47c9-bfed-4b13a20188ad'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.818496 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] The token cache is being invalidate because project efc4f1ab91d84dd3ba924b535aa9fbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:14.818780 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.819439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.821037 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1221/2479] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:14 2021] DELETE /identity/v3/projects/efc4f1ab91d84dd3ba924b535aa9fbd3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:14.825272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:14.835746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a9e4d-37a0-4b03-8b4a-9ba6a653c02f service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:14.897854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:14.898731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:14.899079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:14.899362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] PATH_INFO: `/v3/users/58f29c0b20be4ae69d11ec02553a2361` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:14.900608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f29c0b20be4ae69d11ec02553a2361)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:14.902525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:14.951413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f29c0b20be4ae69d11ec02553a2361'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.952134 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f29c0b20be4ae69d11ec02553a2361'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.964437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f29c0b20be4ae69d11ec02553a2361'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.973878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f29c0b20be4ae69d11ec02553a2361'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.974615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-09ab38e7-8b5e-4461-b86c-14297f0f38ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f29c0b20be4ae69d11ec02553a2361'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:14.987873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1259/2480] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:14 2021] DELETE /identity/v3/users/58f29c0b20be4ae69d11ec02553a2361 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:15.313894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.315470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:15.330974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd7a31-8059-47c9-bfed-4b13a20188ad admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.405222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.406142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.406557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.406844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] PATH_INFO: `/v3/projects/006dcf372ccf468aa8adfaaa9e854df8` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.408177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006dcf372ccf468aa8adfaaa9e854df8)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.410079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.461655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006dcf372ccf468aa8adfaaa9e854df8', 'request_id': 'req-92533f93-f1f6-4a26-99d6-a5379c04f1a2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:15.468934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006dcf372ccf468aa8adfaaa9e854df8', 'request_id': 'req-92533f93-f1f6-4a26-99d6-a5379c04f1a2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:15.474793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006dcf372ccf468aa8adfaaa9e854df8', 'request_id': 'req-92533f93-f1f6-4a26-99d6-a5379c04f1a2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:15.489920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] The token cache is being invalidate because project 006dcf372ccf468aa8adfaaa9e854df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:15.490319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:15.491049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-92533f93-f1f6-4a26-99d6-a5379c04f1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:15.493770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1222/2481] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:15 2021] DELETE /identity/v3/projects/006dcf372ccf468aa8adfaaa9e854df8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:15.499388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.499913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.500014 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.520189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:15.521581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:15.592464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1260/2482] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:15.601233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.601451 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.602081 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.624965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:15.627296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:15.637460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1223/2483] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:15.643198 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.664063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305e648-5000-4224-8664-0fe31abe11bc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.670056 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.671496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.672199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.672688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.675379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:52:15.675379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.676688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.691663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1261/2484] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:52:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:52:15.696075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.706850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae448b0-5ee5-4a22-9162-020f7ffa3ed7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.712383 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.713292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.713881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.714366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.715266 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.717880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.748698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1224/2485] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:15 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:15.753183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.764243 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89b81-0e48-486c-9ca5-ee3eab5fe5fb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.819728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.820443 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.820730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.821005 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.821722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.823653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.846354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1262/2486] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:15 2021] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:52:15.850802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.862145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fe9b4-4ee5-4146-a757-b25821748c74 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.868185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.869141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.869925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.870182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.871216 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.875416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.894746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1225/2487] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:15 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:15.896076 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.906544 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a051-d05f-42ff-8ac4-24fbb3d0f7b0 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.911280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.912013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.912334 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.912642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.913386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.914994 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2324b4-8782-4d63-bff0-9db0ad793bce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.925568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1263/2488] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:15.929765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:15.939864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95da39f-8570-4df3-8802-ec425e630947 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:15.944550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:15.945450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.945732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.946023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] PATH_INFO: `/v3/projects/15275a0a94064a2d9c161b70b6ccca02/users/a27f59047c4446d08ad68ac4d536f988/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:15.961204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15275a0a94064a2d9c161b70b6ccca02, user_id=a27f59047c4446d08ad68ac4d536f988, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:15.963928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:15.978062 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1226/2489] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:15 2021] PUT /identity/v3/projects/15275a0a94064a2d9c161b70b6ccca02/users/a27f59047c4446d08ad68ac4d536f988/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:15.988684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:15.989000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:15.989247 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.016172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] MFA Rules not processed for user `a27f59047c4446d08ad68ac4d536f988`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:16.017491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:16.080087 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1264/2490] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:52:16.084701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.154691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fa35-cced-4eb0-89e8-a4b89de9bbd3 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.162643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.163476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.163857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.164300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.165169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.167312 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.199853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1227/2491] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:16 2021] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:52:16.204281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.223984 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89909e9-8ea8-4c9b-8333-846009df85bf None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.291785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.292685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.292979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.293392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.293993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.296362 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.319317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1265/2492] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:16 2021] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:16.323525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.339225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df171c77-bedc-4539-bd35-04ab25efad3d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.344756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.345474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.345754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.346026 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.346769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.348429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.360651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1228/2493] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:16 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:16.364911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.375947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352c75-f68d-44b8-8883-6ef91bfb172f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.380702 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.381600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.381879 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.382150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] PATH_INFO: `/v3/projects/15470a7f16b045a1af87d74c2537fd0f/users/51d169380e7b437f9eb8ef91c35f48bb/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.396741 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=15470a7f16b045a1af87d74c2537fd0f, user_id=51d169380e7b437f9eb8ef91c35f48bb, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.399312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.423768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1266/2494] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:16 2021] PUT /identity/v3/projects/15470a7f16b045a1af87d74c2537fd0f/users/51d169380e7b437f9eb8ef91c35f48bb/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:16.425145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.436194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72b9c1-a1bf-4ee5-b55c-5bbfd0894ad9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.493891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.494564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.494873 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.495184 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.495962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.497657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9555d-94dd-4f54-ad22-63cc2c824db9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.507806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1229/2495] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:16 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:16.512393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.523223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162b4a8-fa1a-443f-8efd-db98a80372cf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.528532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.529510 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.529917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.530202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] PATH_INFO: `/v3/projects/15470a7f16b045a1af87d74c2537fd0f/users/51d169380e7b437f9eb8ef91c35f48bb/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.532399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15470a7f16b045a1af87d74c2537fd0f, user_id=51d169380e7b437f9eb8ef91c35f48bb, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.535068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.545618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1267/2496] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:16 2021] PUT /identity/v3/projects/15470a7f16b045a1af87d74c2537fd0f/users/51d169380e7b437f9eb8ef91c35f48bb/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:16.557277 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90ec-956d-4644-ac53-febb7502fe2a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.557587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90ec-956d-4644-ac53-febb7502fe2a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.558020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be90ec-956d-4644-ac53-febb7502fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.588840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d3be90ec-956d-4644-ac53-febb7502fe2a None None] MFA Rules not processed for user `51d169380e7b437f9eb8ef91c35f48bb`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:16.590055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d3be90ec-956d-4644-ac53-febb7502fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:16.658861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1230/2497] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:16 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:16.669309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:16.671117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:16.738455 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0528e62-6c45-4d3f-9b83-2876ae3d837b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:16.742963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:16.743738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:16.744030 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:16.744458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:16.802818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:16.813691 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:16.814338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1268/2498] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:16 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:52:17.812842 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941209-287e-4d64-a805-eeb39aa4b5dc None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:17.813532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941209-287e-4d64-a805-eeb39aa4b5dc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:17.813532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941209-287e-4d64-a805-eeb39aa4b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:17.831515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-1d941209-287e-4d64-a805-eeb39aa4b5dc None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:17.832746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-1d941209-287e-4d64-a805-eeb39aa4b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:17.888722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1231/2499] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:52:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:17.901730 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:17.903131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:17.984116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769e6d-2787-4412-be5b-8bf8e1b6be3b service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:17.990678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:17.991853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:17.991853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:17.991853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:18.001592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:18.003318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:18.012721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1269/2500] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:52:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:52:18.609754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9c8-11df-4741-bc07-7a1fb19ae4e3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:18.610045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9c8-11df-4741-bc07-7a1fb19ae4e3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:18.610330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c9c8-11df-4741-bc07-7a1fb19ae4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:18.628435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f297c9c8-11df-4741-bc07-7a1fb19ae4e3 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:18.629662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f297c9c8-11df-4741-bc07-7a1fb19ae4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:18.637990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1232/2501] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:52:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:18.651131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:18.662425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb1f4-3ff5-4612-b43a-25396cf6d40a service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:18.668796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:18.669450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:18.669745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:18.670037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:18.681033 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:18.682851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:18.692419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1270/2502] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:52:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:52:18.907508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fee21-f955-467f-8efe-9b33577e208a None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:18.908053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fee21-f955-467f-8efe-9b33577e208a None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:18.908053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fee21-f955-467f-8efe-9b33577e208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:18.929446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7a5fee21-f955-467f-8efe-9b33577e208a None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:18.930637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7a5fee21-f955-467f-8efe-9b33577e208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:18.939532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1233/2503] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:52:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:18.952957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:18.964126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715426e-8ff1-4577-9047-e0feb988b006 service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:18.970450 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:18.971102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:18.971383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:18.971655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:18.980516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:18.982150 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:18.990182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1271/2504] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:52:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:52:19.331466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:19.331832 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:19.332208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:19.352041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:19.353387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:19.361432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1234/2505] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:52:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:19.376308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:19.387167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb373e-ae4b-4f82-aa57-cd5ac665e945 service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:19.394522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:19.395641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:19.395811 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:19.396246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:19.406147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:19.408503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc5e17-78d1-46b5-a559-742bd93a198d service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:19.418868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1272/2506] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:52:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:52:19.459856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:19.533524 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d335a7-7565-4e9f-bbc1-7056468bf4bd None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:19.538571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:19.539485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:19.539768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:19.540075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] PATH_INFO: `/v3/users/a27f59047c4446d08ad68ac4d536f988` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:19.541477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27f59047c4446d08ad68ac4d536f988)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:19.546848 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:19.615919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27f59047c4446d08ad68ac4d536f988'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:19.616668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27f59047c4446d08ad68ac4d536f988'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:19.630117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27f59047c4446d08ad68ac4d536f988'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:19.637675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27f59047c4446d08ad68ac4d536f988'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:19.652541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27f59047c4446d08ad68ac4d536f988'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:19.661440 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1235/2507] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:19 2021] DELETE /identity/v3/users/a27f59047c4446d08ad68ac4d536f988 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:19.665946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:19.666232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:19.666538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:19.687868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:19.689117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:19.767295 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1273/2508] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:19.778351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:19.780179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:19.846981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577d4-ce2f-4bcb-b0b5-7abb1a9a5c3a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:19.851443 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:19.852488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:19.852773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:19.853047 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:19.863713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:19.865373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:19.876558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1236/2509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:20.198406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:20.199930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:20.219947 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250148-5ef6-4d1e-a9df-851164f5c92c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:20.224979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:20.225865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:20.226144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:20.226412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] PATH_INFO: `/v3/projects/15275a0a94064a2d9c161b70b6ccca02` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:20.229261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15275a0a94064a2d9c161b70b6ccca02)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:20.233649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:20.292807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15275a0a94064a2d9c161b70b6ccca02', 'request_id': 'req-fa34f31d-c56a-483e-b628-b8e23b6aa201'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.299071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15275a0a94064a2d9c161b70b6ccca02', 'request_id': 'req-fa34f31d-c56a-483e-b628-b8e23b6aa201'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.305207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15275a0a94064a2d9c161b70b6ccca02', 'request_id': 'req-fa34f31d-c56a-483e-b628-b8e23b6aa201'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.320036 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] The token cache is being invalidate because project 15275a0a94064a2d9c161b70b6ccca02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:20.320624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.321435 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.323797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1274/2510] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:20 2021] DELETE /identity/v3/projects/15275a0a94064a2d9c161b70b6ccca02 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:20.328703 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:20.358075 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4f884-3fbd-4da5-b8c4-96e4ba98d4f2 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:20.447386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:20.448640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:20.449116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:20.449593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] PATH_INFO: `/v3/users/51d169380e7b437f9eb8ef91c35f48bb` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:20.452409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d169380e7b437f9eb8ef91c35f48bb)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:20.454768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:20.530240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d169380e7b437f9eb8ef91c35f48bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.531104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d169380e7b437f9eb8ef91c35f48bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.551710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d169380e7b437f9eb8ef91c35f48bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.562441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d169380e7b437f9eb8ef91c35f48bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.579058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6bc72401-5f6a-4bdb-a64e-87403b1ad439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d169380e7b437f9eb8ef91c35f48bb'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:20.588027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1237/2511] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:20 2021] DELETE /identity/v3/users/51d169380e7b437f9eb8ef91c35f48bb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:21.193792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.195296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.209284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f31d-c56a-483e-b628-b8e23b6aa201 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.271333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.272280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.272517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.272780 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] PATH_INFO: `/v3/projects/15470a7f16b045a1af87d74c2537fd0f` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.274023 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15470a7f16b045a1af87d74c2537fd0f)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.275909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.321738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15470a7f16b045a1af87d74c2537fd0f', 'request_id': 'req-0f2faa04-f89b-4772-8a6b-d4632e1792c7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.328413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15470a7f16b045a1af87d74c2537fd0f', 'request_id': 'req-0f2faa04-f89b-4772-8a6b-d4632e1792c7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.334445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15470a7f16b045a1af87d74c2537fd0f', 'request_id': 'req-0f2faa04-f89b-4772-8a6b-d4632e1792c7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.347654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] The token cache is being invalidate because project 15470a7f16b045a1af87d74c2537fd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:21.347938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.348580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0f2faa04-f89b-4772-8a6b-d4632e1792c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.350452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1275/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:21 2021] DELETE /identity/v3/projects/15470a7f16b045a1af87d74c2537fd0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:21.357027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.357895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.358253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.378145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:21.380475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.443810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1238/2513] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:21.452620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.453266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.453744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.473727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:21.474950 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.483519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1276/2514] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:21.488201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.498917 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4e75-159b-404e-94ac-7066a4ad59cb None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.503999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.504745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.504999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.505300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.506051 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:52:21.506364 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.508070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.524078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1239/2515] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:52:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:52:21.526542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.536467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe9ad-41cc-41a6-953f-0a76b00938f4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.541381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.542040 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.542508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.542782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.543503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.546257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.585548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1277/2516] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:21.590212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.605620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987491c-4e1a-4a03-84f2-c5542524b709 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.621184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.625449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.672706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.673071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.673371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.673648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.674408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.676941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.701750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1240/2517] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:21.701989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0759797-ec9e-4f57-a890-b1534ae99549 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.703263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.708274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.709663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.709663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.709825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] PATH_INFO: `/v3/users/6d70e8cff3fd447ab85e4c1ffc5281ef` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.711392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d70e8cff3fd447ab85e4c1ffc5281ef)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.713448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.714493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd55c-9111-41e8-937c-d8b3be174b1d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.719972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.720768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.721119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.721460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.722479 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.724030 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.735200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1241/2518] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:52:21.739640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.751146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8210ca-3ba3-4c60-af8f-797796da535f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.757161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.758262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.759412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.759412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.763753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.765619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.782508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1242/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:21.782706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d70e8cff3fd447ab85e4c1ffc5281ef'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.783385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d70e8cff3fd447ab85e4c1ffc5281ef'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.783626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.785617 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.798252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d70e8cff3fd447ab85e4c1ffc5281ef'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.799421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a705445-37e4-4a6a-977f-a68451b05af5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:21.804879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:21.806277 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.806548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.806865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] PATH_INFO: `/v3/projects/f56e5b4b4b7342cd8a94d15c57867d65/users/8c00879b43504389943ee74560f58ab1/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.809001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d70e8cff3fd447ab85e4c1ffc5281ef'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.810560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a9a9f29d-ea6c-4f64-9daf-dc4d0b282439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d70e8cff3fd447ab85e4c1ffc5281ef'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:21.826191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56e5b4b4b7342cd8a94d15c57867d65, user_id=8c00879b43504389943ee74560f58ab1, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:21.829294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1278/2520] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:21 2021] DELETE /identity/v3/users/6d70e8cff3fd447ab85e4c1ffc5281ef => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:21.833622 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.834417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64fb07-ff51-48cb-b367-a83b74aef045 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:21.836503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.836791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.854853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1243/2521] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:21 2021] PUT /identity/v3/projects/f56e5b4b4b7342cd8a94d15c57867d65/users/8c00879b43504389943ee74560f58ab1/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:21.857839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:21.859218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.865834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:21.866135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:21.866412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:21.902285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] MFA Rules not processed for user `8c00879b43504389943ee74560f58ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:21.903643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:21.944429 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1279/2522] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:52:21.954540 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:21.957859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:22.005389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1244/2523] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:21 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:22.013666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.015197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:22.050194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b635b-ae19-4f3b-ba0f-46baa979891d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.054929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.055611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.055897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.057910 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.070367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.072556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.085264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1280/2524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:52:22.117166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dbc91-b199-4b06-8c98-429b910891f5 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.122023 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.122898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.123187 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.124117 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.139346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.140889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06fe54-c9b3-40d7-9cba-368b5e0498bf service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.151871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1245/2525] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:22 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:22.366171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.368090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:22.389793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d299a0f-dec1-4bcf-9646-e5c8d1b2826d service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.406542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.409607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.409895 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.410172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] PATH_INFO: `/v3/projects/3b4463a1337940a4a17c0d54bb402c3a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.412953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4463a1337940a4a17c0d54bb402c3a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.420646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.495313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4463a1337940a4a17c0d54bb402c3a', 'request_id': 'req-731196cd-f837-490f-8397-ff8ea8559ef4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:22.503945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4463a1337940a4a17c0d54bb402c3a', 'request_id': 'req-731196cd-f837-490f-8397-ff8ea8559ef4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:22.513772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4463a1337940a4a17c0d54bb402c3a', 'request_id': 'req-731196cd-f837-490f-8397-ff8ea8559ef4'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:22.535750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] The token cache is being invalidate because project 3b4463a1337940a4a17c0d54bb402c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:22.536074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:22.536841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-731196cd-f837-490f-8397-ff8ea8559ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:22.538439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1281/2526] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:22 2021] DELETE /identity/v3/projects/3b4463a1337940a4a17c0d54bb402c3a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:22.545553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.546104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.546104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.570341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:22.573107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:22.654288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1246/2527] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:22.661980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.662277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.662560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.683341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:22.684615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:22.693141 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1282/2528] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:22.697565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.707701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f4be-9b68-4ca8-aae9-941c70e1cff7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.712403 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.713071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.713348 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.713620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.714408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:52:22.714710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.716388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.728654 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1247/2529] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:52:22.733654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.743956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47204-af69-45a5-8393-f103d8779c26 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.749184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.749852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.750135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.750552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.751273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.753246 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.781366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1283/2530] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:22 2021] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:22.785924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.795807 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2d01-fcab-481d-9fd8-8331b0a82a9f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.857948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.858676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.858975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.859245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.859951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.861910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.883645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1248/2531] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:22 2021] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:22.888330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.899128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882febe0-8476-45fb-905f-c672c2d42a6d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.904882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.905641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.905927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.906204 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.906975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.908582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.922031 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1284/2532] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:22.926430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.937796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7142-5d7b-47c9-9d41-0f64f3d484c2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.943265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.944130 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.944528 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.944895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:22.945786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:22.947765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc47a9-f52a-4cef-85b3-9dc7eb54a863 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:22.960418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1249/2533] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:22.964864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:22.975911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33408-6307-40d3-a385-f1fd33cf1951 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:22.981928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:22.983560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:22.984105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:22.984439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] PATH_INFO: `/v3/projects/1ea5d1c67b8148c296a148fc85f7c6b1/users/e13de8ba3a7a4b3cbefb1a1fd8d0bbbb/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:23.010163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea5d1c67b8148c296a148fc85f7c6b1, user_id=e13de8ba3a7a4b3cbefb1a1fd8d0bbbb, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:23.013304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:23.029168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1285/2534] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:22 2021] PUT /identity/v3/projects/1ea5d1c67b8148c296a148fc85f7c6b1/users/e13de8ba3a7a4b3cbefb1a1fd8d0bbbb/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:23.041127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:23.041569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:23.042015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:23.077293 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] MFA Rules not processed for user `e13de8ba3a7a4b3cbefb1a1fd8d0bbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:23.078514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:23.140566 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1250/2535] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:23 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:52:23.152125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:23.155241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:23.219829 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804f12-7956-4f40-bc0c-8fd438fb17f8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:23.224125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:23.224834 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:23.225144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:23.225422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:23.235567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:23.237110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:23.246392 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1286/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:23 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:23.518433 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:23.520452 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:23.622597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfa412-9a6c-4d87-973f-fe1c811dd9ce None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:23.633408 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:23.634488 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:23.634788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:23.636243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] PATH_INFO: `/v3/users/cf5c43b0d61241578cf162de6aa559d7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:23.640637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5c43b0d61241578cf162de6aa559d7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:23.642889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:23.734231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5c43b0d61241578cf162de6aa559d7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:23.735362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5c43b0d61241578cf162de6aa559d7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:23.758453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5c43b0d61241578cf162de6aa559d7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:23.788960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5c43b0d61241578cf162de6aa559d7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:23.804509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5e21d618-30ff-41ba-8ab2-8d79ac9fc91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5c43b0d61241578cf162de6aa559d7'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:23.816238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1251/2537] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:23 2021] DELETE /identity/v3/users/cf5c43b0d61241578cf162de6aa559d7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:24.012492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.025440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4ba3b-48c0-48b8-9837-3416eacad358 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.098151 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.099051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.099380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.099665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] PATH_INFO: `/v3/projects/8d773db29571458586043ef5fa3454c2` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.100888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d773db29571458586043ef5fa3454c2)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.103158 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.155695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d773db29571458586043ef5fa3454c2', 'request_id': 'req-a5b2b47e-5631-4b03-a00a-650f142f3aa5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:24.163720 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d773db29571458586043ef5fa3454c2', 'request_id': 'req-a5b2b47e-5631-4b03-a00a-650f142f3aa5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:24.170344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d773db29571458586043ef5fa3454c2', 'request_id': 'req-a5b2b47e-5631-4b03-a00a-650f142f3aa5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:24.188945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] The token cache is being invalidate because project 8d773db29571458586043ef5fa3454c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:24.189174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:24.190542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a5b2b47e-5631-4b03-a00a-650f142f3aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:24.192447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1287/2538] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:24 2021] DELETE /identity/v3/projects/8d773db29571458586043ef5fa3454c2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:24.199792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.200680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.200680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.220392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:24.221757 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:24.289198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1252/2539] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:24.297119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.297412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.297696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.316632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:24.317914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:24.327327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1288/2540] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:24.331812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.342821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90c36c-7b61-436b-8272-dcd1e00541c1 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.347904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.348607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.348884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.349154 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.349903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:52:24.350202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.352183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.364668 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1253/2541] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:52:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:52:24.369916 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.384399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d1de-939c-4f17-9fb8-5746cfdd7207 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.391337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.391997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.392313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.392594 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.393333 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.395245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.425647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1289/2542] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:52:24 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:24.430164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.440619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c20c-a755-4b5d-8fc3-c942d02cc580 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.504577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.505265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.505553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.505957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.506676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.508656 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.530483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1254/2543] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:52:24 2021] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:52:24.534707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.545655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29613e0c-9c0a-47f5-b20d-3688208d09e1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.550887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.551574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.551861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.552185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.552904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.554489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.565009 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1290/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:24.569251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.579830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c31b-a38c-427b-8934-be0891ebcfaf admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.584738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.585414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.585700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.585974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.586725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.588365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec934b-976b-4941-bc40-775cc660b20d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.598816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1255/2545] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:52:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:52:24.605060 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.615755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eac60-5185-464a-9a44-510740d78f84 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.621275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.622406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.622673 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.623047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] PATH_INFO: `/v3/projects/ff8379d8cdb74602af55d34607368946/users/2be52de0330c4617a6cbb63b3180f710/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.637883 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8379d8cdb74602af55d34607368946, user_id=2be52de0330c4617a6cbb63b3180f710, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.640597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.656320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1291/2546] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:52:24 2021] PUT /identity/v3/projects/ff8379d8cdb74602af55d34607368946/users/2be52de0330c4617a6cbb63b3180f710/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:24.661674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.662203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.662203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.681078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:24.682320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:24.742016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1256/2547] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:24.752709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:24.754456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:24.811550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3280ba1-1d5d-4d85-8f97-4ef476550100 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:24.815387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:24.816050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:24.816375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:24.816657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:24.826004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:24.828573 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667b97-f2a3-47d5-a95d-86b8c78554be service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:24.839229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1292/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:52:25.289434 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:25.305227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa69d2-909c-4fc6-bc90-21d73eac6227 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:25.309245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:25.311704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:25.312671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:25.313202 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:25.316878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:25.397482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:25.398951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:25.410345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1257/2549] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:25 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:31.237223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:31.237788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:31.237788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:31.274038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] MFA Rules not processed for user `2be52de0330c4617a6cbb63b3180f710`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:31.275825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:31.361257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1293/2550] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:31 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:52:31.375495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:31.378986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:31.523988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981fc5e-897c-48c5-bbd3-797593287ab2 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:31.525631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:31.527149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:31.536142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:31.536844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:31.537316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:31.537754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:31.549444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:31.551350 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c8160-b35a-44e9-80eb-6355eea98417 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:31.551919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5cd05-df56-4ba0-a8db-30221e481118 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:31.562913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:31.564497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:31.565430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:31.566166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] PATH_INFO: `/v3/users/e13de8ba3a7a4b3cbefb1a1fd8d0bbbb` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:31.568039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13de8ba3a7a4b3cbefb1a1fd8d0bbbb)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:31.572356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:31.588514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1258/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:31 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:31.709286 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13de8ba3a7a4b3cbefb1a1fd8d0bbbb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:31.711364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13de8ba3a7a4b3cbefb1a1fd8d0bbbb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:31.754973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13de8ba3a7a4b3cbefb1a1fd8d0bbbb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:31.778715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13de8ba3a7a4b3cbefb1a1fd8d0bbbb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:31.779272 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13de8ba3a7a4b3cbefb1a1fd8d0bbbb'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:31.823805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1294/2552] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:52:31 2021] DELETE /identity/v3/users/e13de8ba3a7a4b3cbefb1a1fd8d0bbbb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:52:31.829542 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:31.829980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:31.830103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:31.858078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:31.859396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:31.960138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1259/2553] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:52:31.969425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:31.971244 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:32.048086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899251be-9ebd-4fe3-b3d9-534ae11bb3a2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:32.053405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:32.054097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:32.054379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:32.054661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:32.066373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:32.068084 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a145-0d0f-44e9-b442-b434d4c6cf9c service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:32.108996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1295/2554] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:52:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:52:32.816532 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:52:32.818797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:32.842252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdefcb-4193-48fe-ac7b-3db4ff38e372 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:52:32.847829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:52:32.848816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:32.849286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:32.849728 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] PATH_INFO: `/v3/projects/1ea5d1c67b8148c296a148fc85f7c6b1` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:32.851076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea5d1c67b8148c296a148fc85f7c6b1)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:52:32.853630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:52:32.915466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea5d1c67b8148c296a148fc85f7c6b1', 'request_id': 'req-b90e332c-62b5-42d2-a457-707059ab1951'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:32.923133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea5d1c67b8148c296a148fc85f7c6b1', 'request_id': 'req-b90e332c-62b5-42d2-a457-707059ab1951'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:32.929459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea5d1c67b8148c296a148fc85f7c6b1', 'request_id': 'req-b90e332c-62b5-42d2-a457-707059ab1951'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:32.945397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] The token cache is being invalidate because project 1ea5d1c67b8148c296a148fc85f7c6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:52:32.945705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:32.946620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:52:32.948405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1260/2555] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:52:32 2021] DELETE /identity/v3/projects/1ea5d1c67b8148c296a148fc85f7c6b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:52:33.727850 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fa8d-17cd-450b-a9e2-9490b2746141 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:52:33.728410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fa8d-17cd-450b-a9e2-9490b2746141 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:52:33.728519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02fa8d-17cd-450b-a9e2-9490b2746141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:52:33.751631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8b02fa8d-17cd-450b-a9e2-9490b2746141 None None] MFA Rules not processed for user `2be52de0330c4617a6cbb63b3180f710`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:52:33.752906 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8b02fa8d-17cd-450b-a9e2-9490b2746141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:52:33.839991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1296/2556] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:52:33 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:53:03.138425 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:03.140101 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:03.207461 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e332c-62b5-42d2-a457-707059ab1951 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:03.214133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:03.215036 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:03.215321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:03.215646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] PATH_INFO: `/v3/users/8c00879b43504389943ee74560f58ab1` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:03.217094 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c00879b43504389943ee74560f58ab1)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:03.219033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:03.272275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c00879b43504389943ee74560f58ab1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.272994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c00879b43504389943ee74560f58ab1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.285975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c00879b43504389943ee74560f58ab1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.293399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c00879b43504389943ee74560f58ab1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.303953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c00879b43504389943ee74560f58ab1'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.311986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1261/2557] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:53:03 2021] DELETE /identity/v3/users/8c00879b43504389943ee74560f58ab1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:53:03.316633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:03.317156 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:03.317261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:03.335749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:53:03.337069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:03.399754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1297/2558] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:53:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:53:03.410787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:03.413290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:03.474254 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3557080-83b9-4731-8225-0b5cb2e03e99 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:03.478975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:03.479640 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:03.479921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:03.480176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:03.489536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:03.490984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:03.500750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1262/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:03.802274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:03.804749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:03.817752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98246752-dfe3-45e5-81f9-3e73ea110499 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:03.823885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:03.824940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:03.825285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:03.825635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] PATH_INFO: `/v3/projects/f56e5b4b4b7342cd8a94d15c57867d65` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:03.826903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56e5b4b4b7342cd8a94d15c57867d65)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:03.828948 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:03.890293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56e5b4b4b7342cd8a94d15c57867d65', 'request_id': 'req-ee53160a-cf87-45c2-93b3-20b5c3c57ade'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.897086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56e5b4b4b7342cd8a94d15c57867d65', 'request_id': 'req-ee53160a-cf87-45c2-93b3-20b5c3c57ade'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.907983 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56e5b4b4b7342cd8a94d15c57867d65', 'request_id': 'req-ee53160a-cf87-45c2-93b3-20b5c3c57ade'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.922512 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] The token cache is being invalidate because project f56e5b4b4b7342cd8a94d15c57867d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:53:03.922803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.923463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ee53160a-cf87-45c2-93b3-20b5c3c57ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:53:03.925041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1298/2560] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:53:03 2021] DELETE /identity/v3/projects/f56e5b4b4b7342cd8a94d15c57867d65 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:53:08.550514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:08.553172 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:08.565879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0186e-dee3-4935-b7cb-2dd8dccfe5ae service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:08.619462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:08.620113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:08.620431 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:08.620699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:08.622493 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:08.699795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:08.702319 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:08.721287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1263/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:09.603868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:09.604464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:09.604464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:09.622774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] MFA Rules not processed for user `5010bab96b044f0d8d70c422ac1a5ade`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:53:09.624027 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:09.681346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1299/2562] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:53:09 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:53:09.978419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:09.980089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:09.991324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce3c8e-17a9-47fe-ab43-d9c75dda4f02 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:09.995706 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:09.996392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:09.996661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:09.996934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:09.998738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:10.014212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:10.015664 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:10.027028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1264/2563] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:22.037615 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:22.039206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:22.053203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066a4e3-5cd3-4de2-8260-fbf736b34c84 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:22.058391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:22.059179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:22.059488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:22.059749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:22.062124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:22.084723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:22.086329 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:22.095537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1300/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:33.683690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:33.685986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:33.700139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c081-0e8e-4ba9-8794-3f8ee4588a2f service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:33.707401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:33.708049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:33.708360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:33.708602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:33.710601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:33.723253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:33.725242 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:33.739516 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1265/2565] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:33 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:56.534653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:56.552795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac858402-2f40-422a-88c0-e83821ae6fd3 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:56.561759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:56.562706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:56.562706 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:56.563237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:56.570133 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:56.579901 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:56.580354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd68d2-107b-47f9-9ce4-44af91977d73 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:56.597003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1301/2566] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:53:57.875750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:53:57.878628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:57.900435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2073-fde9-402c-b631-aec8a776cafd service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:53:57.907659 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:53:57.908489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:53:57.909114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:53:57.909746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:53:57.911627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:53:57.928919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:53:57.930580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:53:57.944303 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1266/2567] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:53:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:04.067586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:04.068106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:04.068106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:04.087754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:04.089001 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:04.149289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1302/2568] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:54:04 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:04.201333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:04.202846 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:04.281976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd198-a7a9-433d-9b60-05a4b2e269ca service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:04.290147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:04.291239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:04.291529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:04.291786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:04.302261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:04.303891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:04.313006 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1267/2569] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:54:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:54:11.323882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:11.325407 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:11.389917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db341b-9951-48ef-be7b-368b5832873e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:11.394814 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:11.395688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:11.395967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:11.396267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] PATH_INFO: `/v3/users/03d752ef66824af1920c201923719944` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:11.397592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d752ef66824af1920c201923719944)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:11.399499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:11.451716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d752ef66824af1920c201923719944'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.452447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d752ef66824af1920c201923719944'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.464019 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d752ef66824af1920c201923719944'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.474257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d752ef66824af1920c201923719944'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.474949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d752ef66824af1920c201923719944'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.487969 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1303/2570] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:54:11 2021] DELETE /identity/v3/users/03d752ef66824af1920c201923719944 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:11.671289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:11.683971 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d8eea-93d1-4ce9-b3d5-721c594d8572 service swift] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:11.749269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:11.750232 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:11.750510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:11.750808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] PATH_INFO: `/v3/projects/c5e3b4fa99ed478cadc86a6adbcba214` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:11.752890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e3b4fa99ed478cadc86a6adbcba214)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:11.754977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:11.803982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e3b4fa99ed478cadc86a6adbcba214', 'request_id': 'req-ea96eed1-589a-450a-8293-a7dce7cf3a2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.810707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e3b4fa99ed478cadc86a6adbcba214', 'request_id': 'req-ea96eed1-589a-450a-8293-a7dce7cf3a2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.817257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e3b4fa99ed478cadc86a6adbcba214', 'request_id': 'req-ea96eed1-589a-450a-8293-a7dce7cf3a2c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.831518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] The token cache is being invalidate because project c5e3b4fa99ed478cadc86a6adbcba214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:54:11.831518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.832281 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.833892 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1268/2571] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:54:11 2021] DELETE /identity/v3/projects/c5e3b4fa99ed478cadc86a6adbcba214 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:11.838175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:11.839724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:11.856202 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f40897-f3c6-42d9-a4ca-da656a9db841 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:11.914608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:11.915507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:11.915786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:11.916058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] PATH_INFO: `/v3/users/fb0f5811560a4e55b87630c21a7f1550` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:11.917338 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0f5811560a4e55b87630c21a7f1550)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:11.919399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:11.970353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0f5811560a4e55b87630c21a7f1550'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.970979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0f5811560a4e55b87630c21a7f1550'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.982792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0f5811560a4e55b87630c21a7f1550'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.991274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0f5811560a4e55b87630c21a7f1550'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:11.991973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fa700b2e-638a-44f3-80ba-1797203e82ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0f5811560a4e55b87630c21a7f1550'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.005293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1304/2572] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:54:11 2021] DELETE /identity/v3/users/fb0f5811560a4e55b87630c21a7f1550 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:12.188109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.189724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:12.203626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96eed1-589a-450a-8293-a7dce7cf3a2c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.265248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.266056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.266339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.266612 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] PATH_INFO: `/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.267987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc4ae157b8644179b3ffec5cc9cca46)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.269993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.322439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc4ae157b8644179b3ffec5cc9cca46', 'request_id': 'req-f8310a17-599b-46b0-8dbb-b0c66c307dfe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.328541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc4ae157b8644179b3ffec5cc9cca46', 'request_id': 'req-f8310a17-599b-46b0-8dbb-b0c66c307dfe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.334619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc4ae157b8644179b3ffec5cc9cca46', 'request_id': 'req-f8310a17-599b-46b0-8dbb-b0c66c307dfe'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.354456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] The token cache is being invalidate because project 6cc4ae157b8644179b3ffec5cc9cca46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:54:12.354746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.355462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f8310a17-599b-46b0-8dbb-b0c66c307dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:54:12.357199 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1269/2573] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:54:12 2021] DELETE /identity/v3/projects/6cc4ae157b8644179b3ffec5cc9cca46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:12.363949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.364740 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.364911 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.391504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:12.393375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:12.467250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1305/2574] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:12.476034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.476362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.476643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.495322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:12.496681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:12.506796 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1270/2575] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:12.511986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.527482 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351bcbe-6f98-4799-abe6-d8cdc5d2a781 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.535742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.536448 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.536744 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.537013 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.537769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:54:12.538074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.539685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.552323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1306/2576] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:54:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:54:12.559557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.570630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6132-34bc-422c-95f8-21ad09778ad6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.576314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.576973 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.577250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.577515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.578498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.580844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.609721 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1271/2577] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:54:12 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:54:12.614390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.625050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0551b2-67b7-4e67-904e-93f7fdab2b1d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.681712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.682387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.682663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.682933 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.683637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.685557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.714998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1307/2578] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:54:12 2021] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:54:12.719296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.730181 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee46ab-0352-42e9-8074-2456716b0882 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.734883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.735552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.735830 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.736104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.736878 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.738583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.748723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1272/2579] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:54:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:54:12.752596 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.762746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703e00f-144e-49d4-b820-9d0e41b30dc2 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.767637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.768319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.768597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.768867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.769678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.771366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31956-47c1-4558-849a-7ecddf6b8113 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.781535 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1308/2580] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:54:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:54:12.785552 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.795398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80be7cd-3cdd-4163-a70c-6d3c90dd608d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:12.800285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:12.801300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.801582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.801855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] PATH_INFO: `/v3/projects/8522662999744d00a4b23e041e4ada60/users/32542b8b0e454a1ba0e1e18a9cf4dd7d/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.816072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8522662999744d00a4b23e041e4ada60, user_id=32542b8b0e454a1ba0e1e18a9cf4dd7d, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:12.818897 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:12.835219 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1273/2581] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:54:12 2021] PUT /identity/v3/projects/8522662999744d00a4b23e041e4ada60/users/32542b8b0e454a1ba0e1e18a9cf4dd7d/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:12.840364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00b86-40f2-428f-8fe1-d13f5247d572 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:12.840655 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00b86-40f2-428f-8fe1-d13f5247d572 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:12.840930 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a00b86-40f2-428f-8fe1-d13f5247d572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:12.859496 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f9a00b86-40f2-428f-8fe1-d13f5247d572 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:12.860709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f9a00b86-40f2-428f-8fe1-d13f5247d572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:12.920493 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1309/2582] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:12.932279 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:12.935028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:13.006015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989f5c-8c7e-47d6-8f8e-a76c77ef0aea admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:13.010446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:13.011093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:13.011371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:13.011641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:13.021525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:13.022957 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:13.032086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1274/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:16.971605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:16.972131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:16.972131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.006815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] MFA Rules not processed for user `32542b8b0e454a1ba0e1e18a9cf4dd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:17.008052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:17.074385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1310/2584] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:17.079090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.094043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bb9b-52ef-4391-aa28-ebc899a92d51 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.102577 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.103262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.103536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.103820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.104584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.106571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.135314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1275/2585] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:54:17 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:54:17.139619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.153088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2df83-ba15-4456-8b8b-a141582ce958 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.219170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.220195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.220480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.220752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.221464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.224304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.245880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1311/2586] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:54:17 2021] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:54:17.250275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.261371 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dab3a6-3c8a-4862-9404-fe77b134065e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.267043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.267748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.268031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.268309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.269050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.270723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.284767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1276/2587] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:54:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:54:17.288354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.299354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2373fd-334c-4721-8376-0de19875fa45 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.312425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.313375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.313663 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.313942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] PATH_INFO: `/v3/projects/4b2fbc33d10047668d8743369cb2f442/users/c8d020f7bc7a4884a7c1be038aab76d7/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.330421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2fbc33d10047668d8743369cb2f442, user_id=c8d020f7bc7a4884a7c1be038aab76d7, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.333265 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.348008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1312/2588] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:54:17 2021] PUT /identity/v3/projects/4b2fbc33d10047668d8743369cb2f442/users/c8d020f7bc7a4884a7c1be038aab76d7/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:17.352632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.362808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445545c-f072-402b-bb3d-b9220c6f6119 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.420480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.421419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.421699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.421978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.422699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.424315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01f790-7458-4f06-9762-75ac28da90f7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.436033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1277/2589] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:54:17 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:54:17.439321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:17.450007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5b4d3-3c92-49cb-8887-a216ceec68cd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:17.454863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:17.455767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:17.456054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:17.456423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] PATH_INFO: `/v3/projects/4b2fbc33d10047668d8743369cb2f442/users/c8d020f7bc7a4884a7c1be038aab76d7/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:17.458753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2fbc33d10047668d8743369cb2f442, user_id=c8d020f7bc7a4884a7c1be038aab76d7, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:17.461678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:17.472590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1313/2590] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:54:17 2021] PUT /identity/v3/projects/4b2fbc33d10047668d8743369cb2f442/users/c8d020f7bc7a4884a7c1be038aab76d7/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:54:22.278791 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:22.279257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:22.279355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:22.307531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] MFA Rules not processed for user `c8d020f7bc7a4884a7c1be038aab76d7`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:22.308978 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:22.387677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1278/2591] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:22 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:22.398934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:22.400735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:22.478483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0039c-0a8a-4f0a-b32b-366e9b6d8f99 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:22.485154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:22.485822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:22.486107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:22.486383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:22.545046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:22.546650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a9d0-6885-43c5-809e-fd6ee115d664 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:22.556302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1314/2592] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:33.316186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:33.377373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfbb37-dc80-49f3-b5d4-e39f455d9f01 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:33.381043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:33.381732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:33.381998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:33.382284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:33.384143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:33.393686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:33.395146 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2eca9f-21f5-4285-a9fd-8ce301cd0e21 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:33.403121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1279/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:34.534490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:34.535097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:34.535097 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:34.536866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1315/2594] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:54:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 25 04:54:34.545188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:34.545785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:34.546090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:34.568073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] MFA Rules not processed for user `7f881943403942878b4ac80e11c2f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:34.569782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:34.582907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1280/2595] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:54:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:34.596853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:34.599315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:34.613481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b15b56-5c6a-4d70-afe6-96370106ce3d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:34.616991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:34.617668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:34.617960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:34.618342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:34.626441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:34.628504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:34.637977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1316/2596] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:34.728598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:34.730080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:34.808367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99039f-4c61-470f-8f50-c251cb2b96ed None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:34.813749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:34.814421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:34.814709 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:34.814989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:34.817067 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:34.829326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:34.830913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db82248-719a-4df5-ab06-a68fd1de0f79 service placement] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:34.841647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1281/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:35.859391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:35.861317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:35.894369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1937f-541f-411a-8aaf-d9e47c39b30e service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:35.899977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:35.900990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:35.901367 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:35.901736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:35.903656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:35.918808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:35.921075 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:35.933065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1317/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:54:41.655210 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9548c-5e5b-4ace-a178-1071d2bab157 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:41.655788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9548c-5e5b-4ace-a178-1071d2bab157 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:41.655788 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9548c-5e5b-4ace-a178-1071d2bab157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:41.677200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-73c9548c-5e5b-4ace-a178-1071d2bab157 None None] MFA Rules not processed for user `32542b8b0e454a1ba0e1e18a9cf4dd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:41.678432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-73c9548c-5e5b-4ace-a178-1071d2bab157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:41.689678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1282/2599] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:54:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:54:42.078015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:42.088696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e439-36a3-4ff6-8afe-85e16a7b9c15 service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:42.093232 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:42.094012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:42.094352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:42.094657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:42.096931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:42.108387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:42.109826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:42.117798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1318/2600] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:54:48.164660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:48.165203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:48.165203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:48.183573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:54:48.184826 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:48.261815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1283/2601] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:54:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:54:48.275635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:48.277114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:54:48.354920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b74b7c-ba50-46ab-bb0f-10b737cb3da1 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:48.363277 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1376209-7de8-4302-af31-0585da9132be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:48.364046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1376209-7de8-4302-af31-0585da9132be service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:48.364770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1376209-7de8-4302-af31-0585da9132be service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:48.365356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1376209-7de8-4302-af31-0585da9132be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:48.376996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1376209-7de8-4302-af31-0585da9132be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:48.378966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1376209-7de8-4302-af31-0585da9132be service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:48.388320 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1319/2602] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:54:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:54:58.576063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:54:58.589243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7c28-cae7-4267-92ce-8a51e2d38068 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:54:58.594005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:54:58.594670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:54:58.594950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:54:58.595220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:54:58.606890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:54:58.613170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8a8c9-7bfd-417e-9311-028b70ccfbb0 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:54:58.621141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1284/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:54:58 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:55:03.169707 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:03.170241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:03.170412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:03.172223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1320/2604] 10.222.0.36 () {54 vars in 921 bytes} [Thu Nov 25 04:55:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:55:03.178055 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112fa6-3ee8-4498-835f-b8a402b1e1e0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:03.178797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112fa6-3ee8-4498-835f-b8a402b1e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:03.178797 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56112fa6-3ee8-4498-835f-b8a402b1e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:03.216049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-56112fa6-3ee8-4498-835f-b8a402b1e1e0 None None] MFA Rules not processed for user `2a5832639148459ca8895ae9e26e4b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:55:03.217453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-56112fa6-3ee8-4498-835f-b8a402b1e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:55:03.227875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1285/2605] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Nov 25 04:55:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:55:03.241291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:55:03.243029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:55:03.322638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072daa2-f09d-4a50-a348-5f13a4d30d31 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:55:03.326506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db691378f74f4f8792b779ca0181f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:55:03.327489 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:03.327776 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:03.328080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:03.339426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:55:03.340934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:55:03.351942 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1321/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:55:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:55:05.338086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae584a2b-2ee4-4611-b2b8-d8ea3d0ed7fc None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:05.338681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae584a2b-2ee4-4611-b2b8-d8ea3d0ed7fc None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:05.338681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae584a2b-2ee4-4611-b2b8-d8ea3d0ed7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:05.359234 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ae584a2b-2ee4-4611-b2b8-d8ea3d0ed7fc None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:55:05.360750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ae584a2b-2ee4-4611-b2b8-d8ea3d0ed7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:55:05.370021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1286/2607] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Nov 25 04:55:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:55:05.393441 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:55:05.407960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c222c-e670-4824-b9fd-d2a1205dcf2a service glance] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:55:05.416974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:55:05.417857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:05.418201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:05.418515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:05.431161 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:55:05.433601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:55:05.443170 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1322/2608] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:55:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:55:25.889562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b1ec-b166-4447-914a-10282c3b26a0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:25.890078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b1ec-b166-4447-914a-10282c3b26a0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:25.890078 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b1ec-b166-4447-914a-10282c3b26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:25.910615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7577b1ec-b166-4447-914a-10282c3b26a0 None None] MFA Rules not processed for user `2403ee720a14460c9eb69191acfda31a`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:55:25.911808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7577b1ec-b166-4447-914a-10282c3b26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:55:25.920399 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1287/2609] 10.222.0.36 () {58 vars in 967 bytes} [Thu Nov 25 04:55:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:55:25.934053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:55:25.945361 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e9d9a-f292-4ac3-8984-decc0da52b18 service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:55:25.950990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86de70eda88d4d4ea1fdd4bc96bc6ff8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:55:25.951639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:25.952048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:25.952366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:25.962220 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:55:25.963794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:55:25.972672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1323/2610] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Nov 25 04:55:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 25 04:55:36.410421 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:55:36.410991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:55:36.410991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:55:36.429159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] MFA Rules not processed for user `2be52de0330c4617a6cbb63b3180f710`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:55:36.430393 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:55:36.488338 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1288/2611] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:55:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:06.995114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:07.005292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb022b5-2258-48d8-b432-8489a9d2e43e service swift] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:07.009915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:07.010561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:07.010853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:07.011126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:07.013236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:07.085690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:07.087157 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:07.099991 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1324/2612] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:10.387498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:10.389555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:10.405714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1c428-4584-4221-aac8-59e8fe6a44c4 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:10.416482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:10.417793 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:10.418249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:10.418521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] PATH_INFO: `/v3/users/5010bab96b044f0d8d70c422ac1a5ade` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:10.421831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5010bab96b044f0d8d70c422ac1a5ade)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:10.423772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:10.478468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5010bab96b044f0d8d70c422ac1a5ade'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.479103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5010bab96b044f0d8d70c422ac1a5ade'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.492321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5010bab96b044f0d8d70c422ac1a5ade'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.499986 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5010bab96b044f0d8d70c422ac1a5ade'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.508876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-300d6d35-e546-4093-8482-476d4fd72bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5010bab96b044f0d8d70c422ac1a5ade'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.515193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1289/2613] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:10 2021] DELETE /identity/v3/users/5010bab96b044f0d8d70c422ac1a5ade => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:10.703290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:10.715488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ccac5-4e3e-46bf-8d69-ece03a1d1f46 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:10.775267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:10.776138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:10.776447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:10.776721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] PATH_INFO: `/v3/projects/f231a19b2ca6447282b854aaf157e86c` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:10.777938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f231a19b2ca6447282b854aaf157e86c)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:10.779833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:10.833223 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f231a19b2ca6447282b854aaf157e86c', 'request_id': 'req-e909bea6-ebaa-4a68-a011-0657babf04aa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.839224 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f231a19b2ca6447282b854aaf157e86c', 'request_id': 'req-e909bea6-ebaa-4a68-a011-0657babf04aa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.844731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f231a19b2ca6447282b854aaf157e86c', 'request_id': 'req-e909bea6-ebaa-4a68-a011-0657babf04aa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.859263 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] The token cache is being invalidate because project f231a19b2ca6447282b854aaf157e86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:10.859549 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.860231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e909bea6-ebaa-4a68-a011-0657babf04aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:10.861859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1325/2614] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:10 2021] DELETE /identity/v3/projects/f231a19b2ca6447282b854aaf157e86c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:10.867802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:10.868102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:10.868410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:10.887570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:10.888831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:10.951623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1290/2615] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:10.962881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:10.963167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:10.963444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:10.983881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:10.985074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:10.994481 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1326/2616] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:10.999321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.014316 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0608f-659f-4408-9ea7-28cdb7535cce None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.022061 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.022722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.023001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.023268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.024020 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:11.024418 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.026001 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.037941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1291/2617] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:11.042257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.052353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729831b-d5d4-4c0f-ba9f-9cf16d88b8e9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.062118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.062783 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.063063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.063342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.064046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.066112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.115825 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1327/2618] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:11.120536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.131170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d9f9b-4534-40c3-a96d-6a0e51c3cdf9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.194581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.195251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.195534 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.195812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.196570 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.198556 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.220482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1292/2619] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:11.224867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.235668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9bcc0-fec1-41ea-a7dd-498d10323c9f admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.241419 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.242116 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.243104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.243395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.244174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.245787 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.256713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1328/2620] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:11.260880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.271733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96781674-9319-40de-8736-9f0605717f0d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.277477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.278158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.278442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.278713 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.279467 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.281158 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f180d7-e2db-4341-84a6-6f25e2d2101d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.292374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1293/2621] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:11.296712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.307774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060524-ff66-49a7-9c79-8b4defee7a0b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.313107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.314020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.314301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.314571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] PATH_INFO: `/v3/projects/0686c46230c944319f9f4b4cbd6e6030/users/295d8c7f23dd4dd0b64ced5e74ed4dbc/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.329386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0686c46230c944319f9f4b4cbd6e6030, user_id=295d8c7f23dd4dd0b64ced5e74ed4dbc, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.332082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.346735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1329/2622] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:11 2021] PUT /identity/v3/projects/0686c46230c944319f9f4b4cbd6e6030/users/295d8c7f23dd4dd0b64ced5e74ed4dbc/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:11.357509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.357831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.358138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.389056 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] MFA Rules not processed for user `295d8c7f23dd4dd0b64ced5e74ed4dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:11.390365 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:11.454261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1294/2623] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:11.459592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.524166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299dd0-dcb2-44b0-b59c-3fd1800c9779 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.531508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.532507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.532896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.533258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.534414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.537284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.572897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1330/2624] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:11.577177 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.589527 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d153f-0c05-4b98-a4c1-1bac8dfdcf86 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.644249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.644884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.645180 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.645449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.646262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.648193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.673435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1295/2625] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:11.674717 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.685631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46354ae5-31c9-4494-8d5f-c3d912306f57 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.690475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.691146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.691445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.691705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.692704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.694296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.704723 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1331/2626] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:11.709459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.720795 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f560-f0a3-4f28-90bb-391b5f443651 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.726238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.727411 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.727693 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.727956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] PATH_INFO: `/v3/projects/d11a742449364a7cb082bcc23e47c8e2/users/c4d9bb7492fe49f9bc13b877d958d396/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.746432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11a742449364a7cb082bcc23e47c8e2, user_id=c4d9bb7492fe49f9bc13b877d958d396, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.749152 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.765128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1296/2627] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:11 2021] PUT /identity/v3/projects/d11a742449364a7cb082bcc23e47c8e2/users/c4d9bb7492fe49f9bc13b877d958d396/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:11.769833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.780281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42782-a5d9-4bde-bf17-93d31572a1e1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.841684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.842369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.842651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.842924 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.843665 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.845605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733db422-2e93-45c6-8c2b-30199689c411 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.856842 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1332/2628] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:11 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:11.861490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:11.874495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cfa28-ff4b-40a0-99f0-7352a3d72191 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:11.880767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:11.881663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.882070 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.882345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] PATH_INFO: `/v3/projects/d11a742449364a7cb082bcc23e47c8e2/users/c4d9bb7492fe49f9bc13b877d958d396/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.884590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11a742449364a7cb082bcc23e47c8e2, user_id=c4d9bb7492fe49f9bc13b877d958d396, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:11.887262 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:11.898945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1297/2629] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:11 2021] PUT /identity/v3/projects/d11a742449364a7cb082bcc23e47c8e2/users/c4d9bb7492fe49f9bc13b877d958d396/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:11.909292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:11.909590 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:11.909870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:11.935919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] MFA Rules not processed for user `c4d9bb7492fe49f9bc13b877d958d396`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:11.937173 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:12.007542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1333/2630] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:11 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:12.021497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:12.023472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:12.081192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729277a5-304e-493f-b470-043f3deaa6cc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:12.085164 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:12.085810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:12.086091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:12.086367 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:12.095810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:12.097283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:12.108690 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1298/2631] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:12 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:12.188767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:12.199587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85067fe-4f92-4165-aee2-20276033d927 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:12.204302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:12.205032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:12.205308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:12.205585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:12.264749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:12.266172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:12.275199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1334/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:12 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:13.746726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:13.749104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:13.812286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4006d0-dbe9-4ea7-99fd-16e841bb1156 service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:13.815818 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:13.816520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:13.816802 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:13.817076 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:13.819102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:13.879280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:13.880905 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:13.890073 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1299/2633] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:13 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:21.129804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:21.131354 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:21.143888 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cc5f9-5268-492b-919e-b1c6126a8402 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:21.147808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:21.148508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:21.148791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:21.149066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:21.151067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:21.219840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:21.221330 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7b38e-f595-4323-9eb8-c351e8c7af76 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:21.231592 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1335/2634] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:22.575108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:22.586941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431792af-f4b1-4a00-9988-f1e87e91a5a9 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:22.591935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:22.593018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:22.593307 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:22.593579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] PATH_INFO: `/v3/users/295d8c7f23dd4dd0b64ced5e74ed4dbc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:22.595201 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295d8c7f23dd4dd0b64ced5e74ed4dbc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:22.597189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:22.650351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295d8c7f23dd4dd0b64ced5e74ed4dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:22.651195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295d8c7f23dd4dd0b64ced5e74ed4dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:22.664851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295d8c7f23dd4dd0b64ced5e74ed4dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:22.672401 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295d8c7f23dd4dd0b64ced5e74ed4dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:22.685301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295d8c7f23dd4dd0b64ced5e74ed4dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:22.692337 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1300/2635] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:22 2021] DELETE /identity/v3/users/295d8c7f23dd4dd0b64ced5e74ed4dbc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:22.697760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:22.698308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:22.698433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:22.715791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:22.717017 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:22.783657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1336/2636] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:22.791320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:22.793112 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:22.851514 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712559-19a5-4610-be23-58d3781cfe98 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:22.855530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:22.856194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:22.856489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:22.856762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:22.868109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:22.869655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:22.879899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1301/2637] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:56:23.205651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:23.207402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:23.224674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c055-c255-4823-a7bf-e1f7f1c156bb None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:23.236051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:23.237467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:23.237853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:23.238270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] PATH_INFO: `/v3/projects/0686c46230c944319f9f4b4cbd6e6030` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:23.240395 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0686c46230c944319f9f4b4cbd6e6030)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:23.252822 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:23.307179 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0686c46230c944319f9f4b4cbd6e6030', 'request_id': 'req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.314743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0686c46230c944319f9f4b4cbd6e6030', 'request_id': 'req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.321840 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0686c46230c944319f9f4b4cbd6e6030', 'request_id': 'req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.338782 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] The token cache is being invalidate because project 0686c46230c944319f9f4b4cbd6e6030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:23.339364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.340444 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.342086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1337/2638] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:23 2021] DELETE /identity/v3/projects/0686c46230c944319f9f4b4cbd6e6030 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:23.346505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:23.357386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acabf85-6485-4c15-8f84-c8bb84d31da4 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:23.420214 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:23.422263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:23.422263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:23.422263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] PATH_INFO: `/v3/users/c4d9bb7492fe49f9bc13b877d958d396` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:23.423412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d9bb7492fe49f9bc13b877d958d396)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:23.425464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:23.478300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d9bb7492fe49f9bc13b877d958d396'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.479377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d9bb7492fe49f9bc13b877d958d396'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.498544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d9bb7492fe49f9bc13b877d958d396'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.506382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d9bb7492fe49f9bc13b877d958d396'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.515926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1802dacc-0eb4-407e-b70a-aceda0ecb72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d9bb7492fe49f9bc13b877d958d396'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.522766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1302/2639] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:23 2021] DELETE /identity/v3/users/c4d9bb7492fe49f9bc13b877d958d396 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:23.826980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:23.828565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:23.849163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbd3ef-ed9e-44ec-a55c-b7708c0bb014 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:23.915259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:23.916279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:23.916632 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:23.917108 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] PATH_INFO: `/v3/projects/d11a742449364a7cb082bcc23e47c8e2` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:23.918433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11a742449364a7cb082bcc23e47c8e2)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:23.920774 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:23.968946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11a742449364a7cb082bcc23e47c8e2', 'request_id': 'req-0865203c-2a14-4bd6-a2d9-2bb919839d28'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.975606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11a742449364a7cb082bcc23e47c8e2', 'request_id': 'req-0865203c-2a14-4bd6-a2d9-2bb919839d28'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.981004 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11a742449364a7cb082bcc23e47c8e2', 'request_id': 'req-0865203c-2a14-4bd6-a2d9-2bb919839d28'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.997897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] The token cache is being invalidate because project d11a742449364a7cb082bcc23e47c8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:23.998346 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:23.999050 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0865203c-2a14-4bd6-a2d9-2bb919839d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:24.000866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1338/2640] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:23 2021] DELETE /identity/v3/projects/d11a742449364a7cb082bcc23e47c8e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:24.008530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.009019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.009138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.027998 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:24.029259 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:24.104330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1303/2641] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:24.114382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.114788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.115071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.136227 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:24.137748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:24.147393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1339/2642] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:24.151734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.177546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2a51f-24da-4ea1-b3de-33d7b8b05a32 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.183565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.184289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.184578 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.184879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.185650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:24.185962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.187589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.200221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1304/2643] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:56:24.204793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.217766 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b27b44-24cd-480c-9068-3dd096fe61f4 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.223848 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.224572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.224859 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.225201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.225961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.227876 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.283099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1340/2644] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:24.284518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.296260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185e48-6411-4051-adf9-b5aff9f8ffca admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.354759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.355613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.355997 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.356395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.357212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.359240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.385912 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1305/2645] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:24.387627 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.408769 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfd2e0-d96f-40c3-ae98-04d3eef1ba4d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.416323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.417098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.417381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.417661 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.418420 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.420074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.432498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1341/2646] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:24 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:24.436700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.457815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ff05-efff-4248-8241-39143d7f4acc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.465888 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.466919 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.467373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.468000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.468984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.470987 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146427b6-9286-4e62-ab0e-15230666fad2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.483335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1306/2647] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:24 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:24.487579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.505865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619eed3-788f-4037-92f8-a44660ba84d5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.511185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.512917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.512917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.512917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] PATH_INFO: `/v3/projects/8f7680f3bd40481fb6b61344ebfc6d8e/users/c998f0f8680140dc9a2ffeae3d2fa30c/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.529862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7680f3bd40481fb6b61344ebfc6d8e, user_id=c998f0f8680140dc9a2ffeae3d2fa30c, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.532779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.550815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1342/2648] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:24 2021] PUT /identity/v3/projects/8f7680f3bd40481fb6b61344ebfc6d8e/users/c998f0f8680140dc9a2ffeae3d2fa30c/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:24.562167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.562661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.562953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.598066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] MFA Rules not processed for user `c998f0f8680140dc9a2ffeae3d2fa30c`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:24.599615 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:24.668447 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1307/2649] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:24.673208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.741917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4890b-f661-4cab-b7bb-9aea28707ca7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.747688 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.748411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.748696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.748980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.749716 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.751721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.782988 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1343/2650] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:24.784598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.795446 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7385fd-4db9-412b-8a8e-239111e1512d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.880226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.880922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.881204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.881677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.887763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.887763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.911225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1308/2651] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:24 2021] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:56:24.912541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.923353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d1e01-7eec-4a7e-814b-dddea6709e1e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.928856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.929437 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.929721 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.929996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.930742 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.932368 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:24.943085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1344/2652] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:24.947901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:24.958296 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217080-f7d1-4c24-8fcb-7a4faebd39e7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:24.966349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:24.967324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:24.967671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:24.968010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] PATH_INFO: `/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6/users/c3ce8753281a49e08c5d3c95123e2dbc/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:24.983370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4ddcfb24043ae87171fc3d5acaca6, user_id=c3ce8753281a49e08c5d3c95123e2dbc, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:24.986143 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:25.015441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1309/2653] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:24 2021] PUT /identity/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6/users/c3ce8753281a49e08c5d3c95123e2dbc/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:25.017767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:25.030977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573d7-eabb-4d53-bdd4-b3336a267b52 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:25.101772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:25.102518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:25.102823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:25.103094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:25.104089 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:25.105815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385234a-3e51-44a6-af6e-2525aac25a51 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:25.116119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1345/2654] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:25.121414 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:25.136724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5875-5897-42ba-9a2d-57bc891e8dfe admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:25.143362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:25.144423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:25.145309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:25.145769 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] PATH_INFO: `/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6/users/c3ce8753281a49e08c5d3c95123e2dbc/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:25.149191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4ddcfb24043ae87171fc3d5acaca6, user_id=c3ce8753281a49e08c5d3c95123e2dbc, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:25.152573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:25.169555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1310/2655] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:25 2021] PUT /identity/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6/users/c3ce8753281a49e08c5d3c95123e2dbc/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:25.180086 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:25.180390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:25.180872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:25.214613 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] MFA Rules not processed for user `c3ce8753281a49e08c5d3c95123e2dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:25.215854 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:25.301094 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1346/2656] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:25 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:25.314546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:25.316505 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:25.381631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04849a6e-5874-4d8a-a4a7-6260b240be27 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:25.386156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:25.387015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:25.387469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:25.388007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:25.397519 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:25.399341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:25.412342 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1311/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:25 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:25.508626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:25.519618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aaf96f-b9d9-4a0b-aa04-4287cf8bb471 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:25.523379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:25.524082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:25.524586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:25.524865 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:25.599871 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:25.601472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:25.611670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1347/2658] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:25 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:56:28.523874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:28.526050 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:28.595347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bc867-63a3-4a2c-8a7c-4bc25f2e4d0b service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:28.600531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:28.601716 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:28.601995 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:28.602253 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] PATH_INFO: `/v3/users/49c96551c1cd41d5b169ab969fded660` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:28.612704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c96551c1cd41d5b169ab969fded660)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:28.614702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:28.667086 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c96551c1cd41d5b169ab969fded660'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:28.667738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c96551c1cd41d5b169ab969fded660'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:28.679765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c96551c1cd41d5b169ab969fded660'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:28.686492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c96551c1cd41d5b169ab969fded660'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:28.695161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c96551c1cd41d5b169ab969fded660'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:28.701360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1312/2659] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:28 2021] DELETE /identity/v3/users/49c96551c1cd41d5b169ab969fded660 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:28.885498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:28.897275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d778d1-3919-4288-8339-55a54f96122c service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:28.959979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:28.960976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:28.961283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:28.961548 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] PATH_INFO: `/v3/projects/c1554cf6f72d42199fcfe7ce71bac429` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:28.962785 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1554cf6f72d42199fcfe7ce71bac429)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:28.964712 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:29.015609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1554cf6f72d42199fcfe7ce71bac429', 'request_id': 'req-4c46ce38-6154-45f8-a153-247bf8ab2ec9'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.022445 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1554cf6f72d42199fcfe7ce71bac429', 'request_id': 'req-4c46ce38-6154-45f8-a153-247bf8ab2ec9'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.028867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1554cf6f72d42199fcfe7ce71bac429', 'request_id': 'req-4c46ce38-6154-45f8-a153-247bf8ab2ec9'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.042952 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] The token cache is being invalidate because project c1554cf6f72d42199fcfe7ce71bac429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:29.043240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.043900 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.045767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1348/2660] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:28 2021] DELETE /identity/v3/projects/c1554cf6f72d42199fcfe7ce71bac429 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:29.049748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:29.051221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:29.069652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebaa83-459e-442e-9dea-0334719ae99f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:29.132192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:29.133102 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:29.133385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:29.133662 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] PATH_INFO: `/v3/users/e00cde06cd06427ca62e472ca8c64663` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:29.134913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00cde06cd06427ca62e472ca8c64663)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:29.136898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:29.193462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00cde06cd06427ca62e472ca8c64663'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.194314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00cde06cd06427ca62e472ca8c64663'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.207618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00cde06cd06427ca62e472ca8c64663'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.215369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00cde06cd06427ca62e472ca8c64663'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.224609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00cde06cd06427ca62e472ca8c64663'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.231582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1313/2661] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:29 2021] DELETE /identity/v3/users/e00cde06cd06427ca62e472ca8c64663 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:29.427073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:29.428698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:29.443914 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ce38-6154-45f8-a153-247bf8ab2ec9 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:29.504352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:29.505317 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:29.505626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:29.506270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] PATH_INFO: `/v3/projects/8a6ad0e4a41746ed887a54b84546d35a` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:29.507523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6ad0e4a41746ed887a54b84546d35a)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:29.509669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:29.557467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6ad0e4a41746ed887a54b84546d35a', 'request_id': 'req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.563881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6ad0e4a41746ed887a54b84546d35a', 'request_id': 'req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.570383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6ad0e4a41746ed887a54b84546d35a', 'request_id': 'req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.584183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] The token cache is being invalidate because project 8a6ad0e4a41746ed887a54b84546d35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:29.584530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.585176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-75e5cba1-c1a2-40d3-81e8-94ee99bc40d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:29.586899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1349/2662] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:29 2021] DELETE /identity/v3/projects/8a6ad0e4a41746ed887a54b84546d35a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:30.463309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:30.464910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:30.478304 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062559c-e1ed-47c0-b3d2-6392872aefdc admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:30.534464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:30.535330 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:30.535609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:30.535882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] PATH_INFO: `/v3/users/c998f0f8680140dc9a2ffeae3d2fa30c` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:30.537161 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c998f0f8680140dc9a2ffeae3d2fa30c)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:30.539356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:30.589530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c998f0f8680140dc9a2ffeae3d2fa30c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:30.590191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c998f0f8680140dc9a2ffeae3d2fa30c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:30.603471 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c998f0f8680140dc9a2ffeae3d2fa30c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:30.610701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c998f0f8680140dc9a2ffeae3d2fa30c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:30.618669 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c998f0f8680140dc9a2ffeae3d2fa30c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:30.625990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1314/2663] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:30 2021] DELETE /identity/v3/users/c998f0f8680140dc9a2ffeae3d2fa30c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:30.629917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:30.630396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:30.630484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:30.648748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:30.650062 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:30.710939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1350/2664] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:30.722914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:30.724370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:30.790183 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063bb2d-e552-4d5d-9834-1a6ec43b93a7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:30.793891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:30.794548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:30.794835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:30.795116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:30.804264 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:30.805739 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:30.815212 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1315/2665] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:31.107763 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:31.109425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:31.121919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58b10e-3234-4ee9-a7fc-1e811b53f9cc None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:31.127181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:31.128514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.128514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.128755 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] PATH_INFO: `/v3/projects/8f7680f3bd40481fb6b61344ebfc6d8e` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.130145 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7680f3bd40481fb6b61344ebfc6d8e)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:31.132530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:31.194609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7680f3bd40481fb6b61344ebfc6d8e', 'request_id': 'req-fcd00821-cb74-4a74-85a2-de1de60c0d68'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.201289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7680f3bd40481fb6b61344ebfc6d8e', 'request_id': 'req-fcd00821-cb74-4a74-85a2-de1de60c0d68'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.207634 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7680f3bd40481fb6b61344ebfc6d8e', 'request_id': 'req-fcd00821-cb74-4a74-85a2-de1de60c0d68'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.226449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] The token cache is being invalidate because project 8f7680f3bd40481fb6b61344ebfc6d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:31.226640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.227276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.228908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1351/2666] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:31 2021] DELETE /identity/v3/projects/8f7680f3bd40481fb6b61344ebfc6d8e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:31.233124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:31.243508 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88814d22-0bf9-4ada-a996-6c54b546b981 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:31.300771 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:31.301685 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.301962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.302233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] PATH_INFO: `/v3/users/c3ce8753281a49e08c5d3c95123e2dbc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.303724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ce8753281a49e08c5d3c95123e2dbc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:31.305655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:31.353324 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ce8753281a49e08c5d3c95123e2dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.354083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ce8753281a49e08c5d3c95123e2dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.367510 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ce8753281a49e08c5d3c95123e2dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.374782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ce8753281a49e08c5d3c95123e2dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.382786 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-396719b6-b302-409f-b52e-fa5e710efc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ce8753281a49e08c5d3c95123e2dbc'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.388816 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1316/2667] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:31 2021] DELETE /identity/v3/users/c3ce8753281a49e08c5d3c95123e2dbc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:31.665598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:31.667205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:31.680703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd00821-cb74-4a74-85a2-de1de60c0d68 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:31.738908 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:31.739681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.739967 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.740278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] PATH_INFO: `/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.741503 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b4ddcfb24043ae87171fc3d5acaca6)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:31.743423 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:31.794169 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b4ddcfb24043ae87171fc3d5acaca6', 'request_id': 'req-8e755049-24d3-4c2a-9861-8eadf720986c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.800434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b4ddcfb24043ae87171fc3d5acaca6', 'request_id': 'req-8e755049-24d3-4c2a-9861-8eadf720986c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.806352 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b4ddcfb24043ae87171fc3d5acaca6', 'request_id': 'req-8e755049-24d3-4c2a-9861-8eadf720986c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.821872 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] The token cache is being invalidate because project b4b4ddcfb24043ae87171fc3d5acaca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:31.822217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.822909 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-8e755049-24d3-4c2a-9861-8eadf720986c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:31.824711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1352/2668] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:31 2021] DELETE /identity/v3/projects/b4b4ddcfb24043ae87171fc3d5acaca6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:31.832208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.832741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.832741 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.851682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:31.852923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:31.918198 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1317/2669] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:31.926194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.926507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.926791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.947550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:31.948873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:31.958323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1353/2670] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:31.962991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:31.973536 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a038f9-a264-4cd6-9798-d06d04f89bc7 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:31.979221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:31.979891 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:31.980188 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:31.980495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:31.981249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:31.981562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:31.983182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:31.995666 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1318/2671] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:32.000026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.010174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b784d-e225-4c90-ac49-52ddc7f78eb0 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.015364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.016063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.016375 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.016659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.017381 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.019388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.047815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1354/2672] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:31 2021] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:32.051976 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.063092 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa9eab-2de3-41cf-8a37-4baedfa8f54b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.123406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.124127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.124466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.124720 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.125469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.127429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.152351 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1319/2673] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:32 2021] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:56:32.153828 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.164383 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e0f9-8669-4756-9913-4d335de7e7bf admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.169568 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.170269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.170547 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.170819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.171561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.173201 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.184431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1355/2674] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:32.188608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.199354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9498905-a38b-4f0f-b842-1e4e155d8d39 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.205415 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.206110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.206388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.206657 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.207396 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.209043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f3f42-87c5-48af-83e2-138988021aac admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.220077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1320/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:32.224729 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.235180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae624053-7790-4f64-aead-b3c483c3afa8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.240058 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.240976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.241260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.241616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] PATH_INFO: `/v3/projects/162352fa98db4ecb840572d90a0d2a75/users/439125127d15486582d0e5ba38bb4e25/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.257321 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162352fa98db4ecb840572d90a0d2a75, user_id=439125127d15486582d0e5ba38bb4e25, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.260385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.275591 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1356/2676] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:32 2021] PUT /identity/v3/projects/162352fa98db4ecb840572d90a0d2a75/users/439125127d15486582d0e5ba38bb4e25/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:32.286320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.286579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.286860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.316107 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] MFA Rules not processed for user `439125127d15486582d0e5ba38bb4e25`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:32.317356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:32.388837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1321/2677] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:32 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:32.400507 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.402332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:32.464242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943153a-079c-423f-9acf-2ec9c19b7c40 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.467864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.468570 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.468960 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.469597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.478376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.479849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33a006-b739-4b7d-ae2a-eab7041805bf service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.488626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1357/2678] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:32 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:32.508176 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.575782 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdde855-d2ce-45f7-b7b5-57c99f8b0b70 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.580994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.581871 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.582156 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.582432 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] PATH_INFO: `/v3/users/439125127d15486582d0e5ba38bb4e25` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.583671 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=439125127d15486582d0e5ba38bb4e25)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.585697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.635497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439125127d15486582d0e5ba38bb4e25'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:32.636191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439125127d15486582d0e5ba38bb4e25'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:32.648723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439125127d15486582d0e5ba38bb4e25'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:32.655679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439125127d15486582d0e5ba38bb4e25'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:32.664914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439125127d15486582d0e5ba38bb4e25'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:32.671278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1322/2679] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:32 2021] DELETE /identity/v3/users/439125127d15486582d0e5ba38bb4e25 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:32.675921 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.676430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.676533 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.700120 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:32.701525 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:32.762608 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1358/2680] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:32.773643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:32.775106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:32.836984 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929abe-3d91-484d-bd11-b204d4efcd3b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:32.841308 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:32.841960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:32.842244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:32.842525 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:32.853021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:32.854495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56f43-7206-42f5-a558-bbffb774f06c service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:32.864268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1323/2681] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:33.143065 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.144639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:33.157453 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc4f3b-7614-4a1a-b353-2857c6e0416b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.162996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.164203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.165000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.165260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] PATH_INFO: `/v3/projects/162352fa98db4ecb840572d90a0d2a75` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.166554 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=162352fa98db4ecb840572d90a0d2a75)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.168660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.228306 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162352fa98db4ecb840572d90a0d2a75', 'request_id': 'req-ec816e5e-7391-4b15-819f-05fb0f602ede'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:33.234264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162352fa98db4ecb840572d90a0d2a75', 'request_id': 'req-ec816e5e-7391-4b15-819f-05fb0f602ede'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:33.240332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162352fa98db4ecb840572d90a0d2a75', 'request_id': 'req-ec816e5e-7391-4b15-819f-05fb0f602ede'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:33.259168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] The token cache is being invalidate because project 162352fa98db4ecb840572d90a0d2a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:33.259456 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:33.260118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ec816e5e-7391-4b15-819f-05fb0f602ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:33.261695 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1359/2682] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:33 2021] DELETE /identity/v3/projects/162352fa98db4ecb840572d90a0d2a75 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:33.267589 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.267877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.268169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.286812 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:33.287931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:33.359583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1324/2683] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:33.369974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.370287 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.370692 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.391641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:33.392881 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:33.402410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1360/2684] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:33.406750 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.416835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5148c-2397-45ac-a56d-7f5779a8aff9 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.422160 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.422833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.423126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.423405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.424168 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:33.424515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.426160 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.438302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1325/2685] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:33.442727 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.453431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133df5ac-7c22-40db-8650-da5df316c747 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.459073 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.459749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.460332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.460625 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.461374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.463400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.490038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1361/2686] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:33 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:56:33.494373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.504744 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8824e8-6cd4-4c3d-9d90-a280dac3534f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.570506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.571641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.571641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.571857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.572509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.574453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.598893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1326/2687] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:33 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:33.603325 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.614289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca20c5-5bfa-40f8-b98c-160e12b5fb98 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.619694 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.620400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.620685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.620956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.621690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.623293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.634228 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1362/2688] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:33.638594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.649619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4004862-fc74-4cad-b079-2bdf2f7bed5b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.655586 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.656470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.656778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.657069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.657809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.659481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f71f2c-e626-457d-b561-eb7b98ad9f5c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.670185 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1327/2689] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:33.674938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.687308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5af4-170d-44da-9546-8879431502ed admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.693398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.694312 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.694633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.695020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] PATH_INFO: `/v3/projects/0d80ef20b8db417f95ea30c913568fe0/users/96648140657c470f9751d050cb0d9138/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.711132 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d80ef20b8db417f95ea30c913568fe0, user_id=96648140657c470f9751d050cb0d9138, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.713818 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.735298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1363/2690] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:33 2021] PUT /identity/v3/projects/0d80ef20b8db417f95ea30c913568fe0/users/96648140657c470f9751d050cb0d9138/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:33.749600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db3c45-c239-400e-9caf-504da93f250b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.749968 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db3c45-c239-400e-9caf-504da93f250b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.750321 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db3c45-c239-400e-9caf-504da93f250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.780869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-94db3c45-c239-400e-9caf-504da93f250b None None] MFA Rules not processed for user `96648140657c470f9751d050cb0d9138`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:33.782104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-94db3c45-c239-400e-9caf-504da93f250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:33.846544 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1328/2691] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:33 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:33.858781 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:33.860669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:33.923957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc08e9-accb-47dd-8525-c0294604bd7b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:33.930038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:33.931147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:33.931640 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:33.932138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:33.942480 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:33.943917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856b395-7389-4b86-8ece-e0485ce502f2 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:33.953733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1364/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:33 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:41.358195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db3c45-c239-400e-9caf-504da93f250b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:41.423994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db3c45-c239-400e-9caf-504da93f250b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:41.429263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:41.430138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:41.430419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:41.430686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] PATH_INFO: `/v3/users/96648140657c470f9751d050cb0d9138` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:41.431972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96648140657c470f9751d050cb0d9138)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:41.434256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:41.482620 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96648140657c470f9751d050cb0d9138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:41.483381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96648140657c470f9751d050cb0d9138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:41.496407 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96648140657c470f9751d050cb0d9138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:41.504448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96648140657c470f9751d050cb0d9138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:41.514147 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96648140657c470f9751d050cb0d9138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:41.521515 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1329/2693] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:41 2021] DELETE /identity/v3/users/96648140657c470f9751d050cb0d9138 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:41.528266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:41.528767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:41.529252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:41.549809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:41.551165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:41.627977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1365/2694] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:41.644353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:41.646331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:41.706032 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7812-bd03-4fa3-9a22-79cab420e778 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:41.710083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:41.710740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:41.711019 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:41.711291 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:41.721258 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:41.722748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84ddaf-fbe0-4448-9814-bda6f35a01c3 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:41.732231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1330/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:42.016314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.017827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:42.031374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b933d8-126c-4baf-91c4-c2b6e294c600 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.036973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.038168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.038561 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.038932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] PATH_INFO: `/v3/projects/0d80ef20b8db417f95ea30c913568fe0` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.048491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d80ef20b8db417f95ea30c913568fe0)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.050560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.105122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d80ef20b8db417f95ea30c913568fe0', 'request_id': 'req-34e23d27-fa0e-4feb-944b-a23eeae99bf2'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.112348 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d80ef20b8db417f95ea30c913568fe0', 'request_id': 'req-34e23d27-fa0e-4feb-944b-a23eeae99bf2'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.120993 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d80ef20b8db417f95ea30c913568fe0', 'request_id': 'req-34e23d27-fa0e-4feb-944b-a23eeae99bf2'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.137008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] The token cache is being invalidate because project 0d80ef20b8db417f95ea30c913568fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:42.137373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.138099 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-34e23d27-fa0e-4feb-944b-a23eeae99bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.139851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1366/2696] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:42 2021] DELETE /identity/v3/projects/0d80ef20b8db417f95ea30c913568fe0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:42.146121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.146503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.146898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.169930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:42.171251 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:42.232464 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1331/2697] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:42.240672 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.240964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.241245 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.263581 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:42.264880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:42.274229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1367/2698] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:42.279459 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.293269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf020c2-5ac5-4686-a5b4-a3f59fd1e509 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.299124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.299785 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.300071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.300377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.301128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:42.301441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.303082 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.315633 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1332/2699] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:42.321856 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.335810 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b855ad-25d0-4e97-a00f-a0efe21472a3 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.341745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.342438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.342715 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.343128 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.343681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.346008 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.376315 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1368/2700] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:42 2021] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:42.380691 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.391257 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0cae-6cde-4ae1-8500-dc21ad6efbb4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.449213 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.449872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.450150 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.450419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.451119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.453071 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.476680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1333/2701] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:42 2021] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:42.480975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.491219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7735e70-ead3-4cec-9a67-1e504ef0165b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.496119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.496809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.497092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.497370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.498110 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.499724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.510183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1369/2702] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:42.514400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.525576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2539-50f9-4a63-af7f-3b0e8a0aed20 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.531931 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.532639 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.532922 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.533194 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.533938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.535540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79b960-db33-48fc-81aa-963ac334c4c9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.546651 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1334/2703] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:42.550745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.561349 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed00fa6-af57-42dd-9bd7-e4706edf0ad8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.566965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.567940 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.568242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.568623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] PATH_INFO: `/v3/projects/f27eda14fd29457db8176e759ec81563/users/a7686d47dea34215978feb9c25bb7705/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.584919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27eda14fd29457db8176e759ec81563, user_id=a7686d47dea34215978feb9c25bb7705, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.587607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.603738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1370/2704] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:42 2021] PUT /identity/v3/projects/f27eda14fd29457db8176e759ec81563/users/a7686d47dea34215978feb9c25bb7705/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:42.615122 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.615416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.615730 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.644472 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] MFA Rules not processed for user `a7686d47dea34215978feb9c25bb7705`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:42.645681 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:42.712756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1335/2705] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:42 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:42.740268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.742297 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:42.799131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a722-6588-43a4-886d-dfccbd728d93 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.803064 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.803708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.803996 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.804300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.812968 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.814440 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af150d53-8dc3-4ef1-9fdf-f989fce10717 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.823288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1371/2706] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:42 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:42.837384 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:42.907634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3f532-fff6-4003-b68e-b328c914f122 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:42.917197 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:42.918077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:42.918353 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:42.918630 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] PATH_INFO: `/v3/users/a7686d47dea34215978feb9c25bb7705` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:42.919994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7686d47dea34215978feb9c25bb7705)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:42.921965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:42.974108 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7686d47dea34215978feb9c25bb7705'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.974763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7686d47dea34215978feb9c25bb7705'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.987398 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7686d47dea34215978feb9c25bb7705'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:42.994702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7686d47dea34215978feb9c25bb7705'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.006854 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7686d47dea34215978feb9c25bb7705'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.014169 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1336/2707] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:42 2021] DELETE /identity/v3/users/a7686d47dea34215978feb9c25bb7705 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:43.019021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.019310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.019588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.042823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:43.044012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:43.123154 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1372/2708] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:43.134069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.136492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:43.203244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7623-807f-4740-a269-b490acb7426f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.207707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.208406 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.208672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.208943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.218806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.220590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ddaa-4fcb-4613-a426-64cf07625eb2 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.229923 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1337/2709] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:43.517293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.518905 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:43.531210 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4270a-3aab-4d25-b86f-a021e91c639b None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.536260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.537138 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.537417 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.537690 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] PATH_INFO: `/v3/projects/f27eda14fd29457db8176e759ec81563` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.538919 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27eda14fd29457db8176e759ec81563)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.540982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.591082 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27eda14fd29457db8176e759ec81563', 'request_id': 'req-20aaeb64-baf3-46d2-8cf6-201375409bae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.597767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27eda14fd29457db8176e759ec81563', 'request_id': 'req-20aaeb64-baf3-46d2-8cf6-201375409bae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.603275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27eda14fd29457db8176e759ec81563', 'request_id': 'req-20aaeb64-baf3-46d2-8cf6-201375409bae'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.620501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] The token cache is being invalidate because project f27eda14fd29457db8176e759ec81563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:43.620728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.621531 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-20aaeb64-baf3-46d2-8cf6-201375409bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:43.623213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1373/2710] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:43 2021] DELETE /identity/v3/projects/f27eda14fd29457db8176e759ec81563 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:43.629562 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.630083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.630083 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.648306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:43.649502 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:43.707839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1338/2711] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:43.716514 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.716821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.717102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.737269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:43.738732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:43.748614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1374/2712] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:43.753314 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.763571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd838a-7e75-4d36-950d-6f20630b5a79 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.769587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.770299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.770581 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.770861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.771590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:43.771921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.773814 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.786322 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1339/2713] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:43.790735 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.800374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff732a-1b20-493b-8302-50da714719a2 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.805802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.806447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.806792 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.807122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.807935 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.809852 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.841849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1375/2714] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:43 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:43.846770 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.857290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83d697-6abe-4ccc-a3f7-5ce4dbe87fc2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.916701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.917381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.917660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.917936 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.918634 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.921306 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.946386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1340/2715] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:43 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:43.950572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:43.966024 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9367302-bac8-43b7-b30b-c65e38c391df admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:43.971870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:43.972562 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:43.972849 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:43.973126 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:43.973882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:43.975476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:43.986449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1376/2716] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:56:43.990583 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:44.000686 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443bd57-f758-4666-86e8-cbb4a265fb8f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:44.006014 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:44.006667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:44.006950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:44.007233 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:44.007992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:44.009628 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c518-b55e-48dc-84d0-be4b03a60eb7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:44.019439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1341/2717] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:44.023598 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:44.034083 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbc682-3eec-45fd-bb55-189969ef44d8 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:44.039118 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:44.039998 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:44.040310 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:44.040587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] PATH_INFO: `/v3/projects/a45575354c2e4f53aba35bf5d29d00cd/users/8afde737c5f14fe8a4db9cac1b54c100/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:44.055396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45575354c2e4f53aba35bf5d29d00cd, user_id=8afde737c5f14fe8a4db9cac1b54c100, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:44.058314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:44.073611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1377/2718] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:44 2021] PUT /identity/v3/projects/a45575354c2e4f53aba35bf5d29d00cd/users/8afde737c5f14fe8a4db9cac1b54c100/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:44.084178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:44.084495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:44.084777 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:44.121386 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] MFA Rules not processed for user `8afde737c5f14fe8a4db9cac1b54c100`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:44.122593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:44.192272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1342/2719] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:44.204644 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:44.206609 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:44.265152 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81970bab-f662-4729-ac14-e5e8a317f736 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:44.269733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:44.270377 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:44.270660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:44.270927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:44.279604 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:44.281066 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73031d-ea93-483b-ac9b-344e607d1d91 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:44.289807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1378/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:44 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:46.850543 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:46.916106 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f2277-a4b4-463b-9dde-d928083eb593 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:46.921111 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:46.921989 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:46.922276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:46.922540 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] PATH_INFO: `/v3/users/8afde737c5f14fe8a4db9cac1b54c100` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:46.923840 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afde737c5f14fe8a4db9cac1b54c100)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:46.925737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:46.977054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afde737c5f14fe8a4db9cac1b54c100'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:46.977710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afde737c5f14fe8a4db9cac1b54c100'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:46.989260 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afde737c5f14fe8a4db9cac1b54c100'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:46.995717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afde737c5f14fe8a4db9cac1b54c100'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.007301 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afde737c5f14fe8a4db9cac1b54c100'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.014104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1343/2721] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:56:46 2021] DELETE /identity/v3/users/8afde737c5f14fe8a4db9cac1b54c100 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:47.019777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.020291 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.020418 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.042079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:47.043709 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:47.115374 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1379/2722] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:47.125815 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.127346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:47.194665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c81976-169f-4fea-ab02-f4a5938cabe7 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.199559 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.200621 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.200939 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.201245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.216880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.219373 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18643e-1e6e-4f0c-8560-7cd0acd8cc9b service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.242742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1344/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:47.518620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.520088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:47.533442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787f6d-5500-4ba7-971b-9108612000d9 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.538541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.539474 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.539759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.540032 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] PATH_INFO: `/v3/projects/a45575354c2e4f53aba35bf5d29d00cd` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.541484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45575354c2e4f53aba35bf5d29d00cd)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.543666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.593186 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45575354c2e4f53aba35bf5d29d00cd', 'request_id': 'req-7013e067-919b-4421-b886-5d993a8a6a6a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.600177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45575354c2e4f53aba35bf5d29d00cd', 'request_id': 'req-7013e067-919b-4421-b886-5d993a8a6a6a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.606182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45575354c2e4f53aba35bf5d29d00cd', 'request_id': 'req-7013e067-919b-4421-b886-5d993a8a6a6a'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.620048 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] The token cache is being invalidate because project a45575354c2e4f53aba35bf5d29d00cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:56:47.620384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.621127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7013e067-919b-4421-b886-5d993a8a6a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:56:47.622864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1380/2724] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:56:47 2021] DELETE /identity/v3/projects/a45575354c2e4f53aba35bf5d29d00cd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:56:47.628928 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.629218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.629497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.649041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:47.650166 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:47.709463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1345/2725] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:47.719360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.719650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.719927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.740433 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:47.741624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:47.749805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1381/2726] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:47.754153 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.764035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a87e35-0922-4a05-a8ec-3c17c2a20a20 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.768850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.769538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.769821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.770090 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.770835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:56:47.771139 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.772775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.784778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1346/2727] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:56:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:56:47.789767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.801255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874b3f6-aa4e-4fae-ae2d-ca158552b3ba None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.806985 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.807664 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.807977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.808285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.809067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.811047 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.839733 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1382/2728] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:56:47 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:56:47.844470 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.855049 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392c832-ed34-4227-80f2-68ff734fc392 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.916580 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.917392 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.917773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.918203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.918932 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.920947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.942138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1347/2729] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:56:47 2021] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:56:47.947746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.958805 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dea329-96fc-4f6f-aaeb-5e366c5790c5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:47.964403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:47.965274 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:47.965565 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:47.965847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:47.966617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:47.968262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:47.979797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1383/2730] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:47.984458 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:47.994996 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be14e6e-93eb-44c9-89cd-3ff10749f8ab admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:48.000221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:48.000937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:48.001221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:48.001498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:48.002243 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:48.003859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b2bf-9120-4797-8fbc-44b3d06d4dfd admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:48.014287 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1348/2731] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:56:48.018637 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:48.028778 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c860-89b7-4f89-94b7-0236beea53ef admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:48.033560 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:48.034449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:48.034731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:48.035010 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] PATH_INFO: `/v3/projects/f2fc92afbcbd4ebcad522e660bb5e8da/users/a70b4ceee58f432c83bc2c1137ecc537/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:48.050072 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fc92afbcbd4ebcad522e660bb5e8da, user_id=a70b4ceee58f432c83bc2c1137ecc537, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:48.052878 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:48.068305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1384/2732] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:56:48 2021] PUT /identity/v3/projects/f2fc92afbcbd4ebcad522e660bb5e8da/users/a70b4ceee58f432c83bc2c1137ecc537/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:56:48.073809 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706313-8eb8-435d-b81e-09f71ebf0fa0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:48.074089 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706313-8eb8-435d-b81e-09f71ebf0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:48.074419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706313-8eb8-435d-b81e-09f71ebf0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:48.092011 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-89706313-8eb8-435d-b81e-09f71ebf0fa0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:48.093263 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-89706313-8eb8-435d-b81e-09f71ebf0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:48.153847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1349/2733] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:56:48.164080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:48.166002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:48.224192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75973aef-d6c0-4b9e-9a39-67f5cfce7ce5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:48.228168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:48.228931 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:48.229241 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:48.229518 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:48.239841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:48.241359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:48.251268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1385/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:56:48.872861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa4b5-3ae4-410b-966a-9e605de48fd4 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:48.873427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa4b5-3ae4-410b-966a-9e605de48fd4 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:48.873683 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fa4b5-3ae4-410b-966a-9e605de48fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:48.902810 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-f43fa4b5-3ae4-410b-966a-9e605de48fd4 None None] MFA Rules not processed for user `a70b4ceee58f432c83bc2c1137ecc537`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:48.904343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-f43fa4b5-3ae4-410b-966a-9e605de48fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:48.973148 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1350/2735] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:48 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:48.980461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:48.981903 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:49.039671 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325391d3-10cb-4f40-95db-c41110340f58 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:49.044532 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:49.045192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:49.045475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:49.045746 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:49.054885 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:49.056563 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f07f8-3ec5-45ab-a670-21c54cb0c36e service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:49.066163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1386/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:48 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:56:50.451039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d985a6-452b-4079-abe3-4632edd21ce5 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:50.451594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d985a6-452b-4079-abe3-4632edd21ce5 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:50.451767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d985a6-452b-4079-abe3-4632edd21ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:50.480246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d3d985a6-452b-4079-abe3-4632edd21ce5 None None] MFA Rules not processed for user `a70b4ceee58f432c83bc2c1137ecc537`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:50.481539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d3d985a6-452b-4079-abe3-4632edd21ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:50.490042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1351/2737] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:56:50 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:51.553693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8957-8258-4b77-a0d0-460fd6cb6c25 None None] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:51.554251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8957-8258-4b77-a0d0-460fd6cb6c25 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:51.554251 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8957-8258-4b77-a0d0-460fd6cb6c25 None None] PATH_INFO: `/` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:51.556231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1387/2738] 10.222.0.36 () {54 vars in 960 bytes} [Thu Nov 25 04:56:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 25 04:56:51.562811 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:51.563286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:51.563391 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:51.608043 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] MFA Rules not processed for user `755f10706c5f44a79cc402f6accd1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:56:51.609288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:51.676144 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1352/2739] 10.222.0.36 () {58 vars in 1057 bytes} [Thu Nov 25 04:56:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:56:51.684172 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8957-8258-4b77-a0d0-460fd6cb6c25 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:56:51.698861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8957-8258-4b77-a0d0-460fd6cb6c25 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:56:51.704107 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:56:51.704786 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:56:51.705061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:56:51.705360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:56:51.707149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:56:51.721556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:56:51.723177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:56:51.735135 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1388/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:56:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:04.083763 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.085356 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:04.109069 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ff5a9-319a-4a1b-88c6-3e4ff2e6c719 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.114450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.115439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.115790 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.116206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] PATH_INFO: `/v3/users/2be52de0330c4617a6cbb63b3180f710` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.117537 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be52de0330c4617a6cbb63b3180f710)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.119637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.176272 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be52de0330c4617a6cbb63b3180f710'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.176950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be52de0330c4617a6cbb63b3180f710'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.188853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be52de0330c4617a6cbb63b3180f710'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.197064 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be52de0330c4617a6cbb63b3180f710'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.206715 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-14a5e2f8-77d7-46b0-80ed-279b9807fd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be52de0330c4617a6cbb63b3180f710'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.212958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1353/2741] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:04 2021] DELETE /identity/v3/users/2be52de0330c4617a6cbb63b3180f710 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:04.406378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.418280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c961-e8e0-4567-8e73-21e256b73392 service placement] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.477982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.478864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.479146 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.479421 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] PATH_INFO: `/v3/projects/ff8379d8cdb74602af55d34607368946` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.480666 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8379d8cdb74602af55d34607368946)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.482704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.531862 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8379d8cdb74602af55d34607368946', 'request_id': 'req-7b75747f-c5c6-439c-ac61-8737b6b49013'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.538207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8379d8cdb74602af55d34607368946', 'request_id': 'req-7b75747f-c5c6-439c-ac61-8737b6b49013'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.543768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8379d8cdb74602af55d34607368946', 'request_id': 'req-7b75747f-c5c6-439c-ac61-8737b6b49013'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.559791 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] The token cache is being invalidate because project ff8379d8cdb74602af55d34607368946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:04.560085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.560864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-7b75747f-c5c6-439c-ac61-8737b6b49013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:04.562513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1389/2742] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:04 2021] DELETE /identity/v3/projects/ff8379d8cdb74602af55d34607368946 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:04.569847 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.570300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.570646 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.590182 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:04.591465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:04.652539 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1354/2743] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:04.664826 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.665105 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.665500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.689463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:04.690685 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:04.699205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1390/2744] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:04.704362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.715374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f5e5f-4a8c-43ca-94f1-3f4d812cb8e6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.721670 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.722347 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.722606 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.722901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.723652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:04.723962 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.725601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.737629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1355/2745] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:04.742326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.751945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a1aed-7594-49b6-b552-1bf4a6e72f48 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.758181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.758860 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.759149 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.759422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.760182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.762119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.794743 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1391/2746] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:04 2021] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:04.799416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.810705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdd9a1-55d7-49ff-aea9-6f7a9b2afd76 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.868173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.868947 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.869239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.869521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.870248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.872369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.902977 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1356/2747] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:04 2021] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:04.907600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.918174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cd7b4-a32f-46c3-b5a7-f217ffcdf556 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.923882 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.924605 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.924874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.925143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.925893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.927483 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.938212 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1392/2748] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:57:04.942397 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.954911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d32f-2ddd-4030-87a7-324c25337a17 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:04.962015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:04.963005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:04.963387 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:04.963707 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:04.964726 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:04.967221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0fbd5-2e6d-4441-a6ce-dede7748dbb4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:04.978226 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1357/2749] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:04 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:04.982902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:04.999285 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ffba6-799b-48e0-af3a-a69b54da387d admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:05.005559 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:05.006470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:05.006753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:05.007020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] PATH_INFO: `/v3/projects/935968d4dd0f4406b917f32d30a02938/users/ab3c405ddb6a47b1ab683503fcb7c447/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:05.023299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935968d4dd0f4406b917f32d30a02938, user_id=ab3c405ddb6a47b1ab683503fcb7c447, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:05.025946 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:05.042090 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1393/2750] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:04 2021] PUT /identity/v3/projects/935968d4dd0f4406b917f32d30a02938/users/ab3c405ddb6a47b1ab683503fcb7c447/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:05.054637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26df8-f166-46b8-826d-13e04cebb754 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:05.054935 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26df8-f166-46b8-826d-13e04cebb754 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:05.055323 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26df8-f166-46b8-826d-13e04cebb754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:05.083647 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-78e26df8-f166-46b8-826d-13e04cebb754 None None] MFA Rules not processed for user `ab3c405ddb6a47b1ab683503fcb7c447`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:05.084921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-78e26df8-f166-46b8-826d-13e04cebb754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:05.152903 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1358/2751] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:05.165464 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:05.168298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:05.247867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a86-a971-436e-bb1b-db710f0b3f36 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:05.254752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:05.255408 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:05.255689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:05.255961 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:05.263874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:05.265611 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:05.274372 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1394/2752] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:12.802317 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1a80c-26b4-413e-9ef2-e52b7bbbd226 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:12.802961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1a80c-26b4-413e-9ef2-e52b7bbbd226 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:12.802961 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1a80c-26b4-413e-9ef2-e52b7bbbd226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:12.821140 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-6ce1a80c-26b4-413e-9ef2-e52b7bbbd226 None None] MFA Rules not processed for user `32542b8b0e454a1ba0e1e18a9cf4dd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:12.822400 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6ce1a80c-26b4-413e-9ef2-e52b7bbbd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:12.882926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1359/2753] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:12 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:13.686115 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:13.752336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b00c-6c1b-48e5-a23a-659783096605 service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:13.757061 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:13.758074 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:13.758422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:13.758697 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] PATH_INFO: `/v3/users/ab3c405ddb6a47b1ab683503fcb7c447` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:13.760016 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3c405ddb6a47b1ab683503fcb7c447)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:13.762002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:13.812391 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3c405ddb6a47b1ab683503fcb7c447'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:13.813165 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3c405ddb6a47b1ab683503fcb7c447'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:13.825358 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3c405ddb6a47b1ab683503fcb7c447'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:13.833021 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3c405ddb6a47b1ab683503fcb7c447'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:13.833628 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3c405ddb6a47b1ab683503fcb7c447'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:13.850679 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1395/2754] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:13 2021] DELETE /identity/v3/users/ab3c405ddb6a47b1ab683503fcb7c447 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:13.853523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:13.854042 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:13.854278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:13.872853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:13.874129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:13.937856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1360/2755] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:13.947941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:13.949457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:14.010182 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469363-fb04-4fc9-8e6d-25134e336dcb admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.013889 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.014580 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.014866 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.015144 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.024288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.026012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090343d-e8f2-4f8d-bc5b-1a4104691d63 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.035953 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1396/2756] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:14.308390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.309855 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:14.323035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d745a1-35ce-4708-a6e8-b551f91305b8 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.327979 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.328899 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.329178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.329441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] PATH_INFO: `/v3/projects/935968d4dd0f4406b917f32d30a02938` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.330860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=935968d4dd0f4406b917f32d30a02938)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.332865 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.380994 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935968d4dd0f4406b917f32d30a02938', 'request_id': 'req-5173c531-06d3-4ec4-b308-12a68cabc47f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:14.386924 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935968d4dd0f4406b917f32d30a02938', 'request_id': 'req-5173c531-06d3-4ec4-b308-12a68cabc47f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:14.392921 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935968d4dd0f4406b917f32d30a02938', 'request_id': 'req-5173c531-06d3-4ec4-b308-12a68cabc47f'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:14.407698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] The token cache is being invalidate because project 935968d4dd0f4406b917f32d30a02938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:14.407992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:14.408678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-5173c531-06d3-4ec4-b308-12a68cabc47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:14.410221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1361/2757] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:14 2021] DELETE /identity/v3/projects/935968d4dd0f4406b917f32d30a02938 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:14.416422 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.416713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.416997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.438385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:14.439577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:14.501268 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1397/2758] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:14.513370 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.513655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.513925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.534829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:14.536053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:14.545412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1362/2759] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:14.550055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.560469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c123-1176-4336-bef8-b4f49a1b812f None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.565258 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.565926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.566205 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.566475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.567341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:14.567614 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.569255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.581601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1398/2760] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:14.586104 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.597363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec3af0-b5d7-4738-af6a-da6e8914d3d2 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.602896 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.603571 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.603853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.604124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.604882 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.606843 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.634844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1363/2761] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:14 2021] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:14.638907 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.649119 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b0a1-55eb-4f27-b43f-f4678e076687 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.709938 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.710684 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.711025 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.711365 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.712812 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.715923 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.748461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1399/2762] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:14 2021] POST /identity/v3/users => generated 278 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:14.752779 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.765031 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff4797-ab37-46fa-af52-f12e5953bb8d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.771119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.772511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.772799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.773128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.778121 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.779869 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.791723 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1364/2763] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:14 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:14.795529 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.806926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cec1-e579-48ab-b999-fe0761ab8c92 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.824077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.824913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.825262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.825603 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.826430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.828102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9424-0b98-4c45-9f32-df515de6e918 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.839887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1400/2764] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:14 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:14.844682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:14.860340 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd26fd-5af2-47f5-8139-99c4eeb77614 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:14.864475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:14.865474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.865829 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.866179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] PATH_INFO: `/v3/projects/a9c417daa7bb4ac4abfd5d6f9230294e/users/17b21cb78f634e5fbf37e9f187d948d5/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.883160 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c417daa7bb4ac4abfd5d6f9230294e, user_id=17b21cb78f634e5fbf37e9f187d948d5, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:14.886123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:14.901520 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1365/2765] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:14 2021] PUT /identity/v3/projects/a9c417daa7bb4ac4abfd5d6f9230294e/users/17b21cb78f634e5fbf37e9f187d948d5/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:14.911880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:14.912390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:14.912708 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:14.941203 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] MFA Rules not processed for user `17b21cb78f634e5fbf37e9f187d948d5`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:14.942431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:15.005214 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1401/2766] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:14 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:15.009858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.072329 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eafaf4-0b6d-4c38-b165-0150605863b2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.077557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.078221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.078507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.078783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.079497 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.081450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.108361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1366/2767] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:15 2021] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:15.112689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.123710 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5dbc9-8b50-4a1f-95f0-c24c164599d6 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.179303 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.180012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.180400 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.180676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.181427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.183491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.204536 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1402/2768] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:15 2021] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:15.208696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.220280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6fdd-695f-4e6a-be32-d8e194757a97 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.225697 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.226550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.226904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.227207 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.228035 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.229753 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.240278 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1367/2769] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:15.244789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.254762 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40fb14-723d-4376-a87b-8df5eb762dac admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.259471 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.260401 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.260686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.260965 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] PATH_INFO: `/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d/users/dd49cad51eb04cc8a6a9f8de35767a42/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.277360 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b88cbc26b84e82896f8b7c2f81420d, user_id=dd49cad51eb04cc8a6a9f8de35767a42, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.280237 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.296584 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1403/2770] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:15 2021] PUT /identity/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d/users/dd49cad51eb04cc8a6a9f8de35767a42/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:15.300546 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.311300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a654ad-c603-4836-a940-a7a1a464d750 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.371760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.372591 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.372853 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.373126 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.373956 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.375819 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d58c4-75d4-48a9-81e7-89d55cde36b1 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.390361 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1368/2771] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:15.391693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.405784 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4050-0d71-4e57-99df-d54fa0f26d50 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.414398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.415749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.416229 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.416636 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] PATH_INFO: `/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d/users/dd49cad51eb04cc8a6a9f8de35767a42/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.422917 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b88cbc26b84e82896f8b7c2f81420d, user_id=dd49cad51eb04cc8a6a9f8de35767a42, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.425255 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.438168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1404/2772] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:15 2021] PUT /identity/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d/users/dd49cad51eb04cc8a6a9f8de35767a42/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:15.450380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.450380 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.456958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.497455 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] MFA Rules not processed for user `dd49cad51eb04cc8a6a9f8de35767a42`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:15.498884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:15.585595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1369/2773] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:15 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:15.597187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.599835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:15.683752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0377-f0bd-4f53-9e54-24a04910e786 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.688077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587277e7-b449-4660-b175-293959771254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.688861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587277e7-b449-4660-b175-293959771254 service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.689148 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587277e7-b449-4660-b175-293959771254 service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.689424 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587277e7-b449-4660-b175-293959771254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.705296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587277e7-b449-4660-b175-293959771254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.706804 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587277e7-b449-4660-b175-293959771254 service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.719045 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1405/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:15 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:15.830852 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:15.833292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:15.850862 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5119b-e8e4-43da-9875-40d9225c8fe3 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:15.855244 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:15.856491 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:15.857004 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:15.857499 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:15.931442 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:15.933249 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245fd94-3781-41a8-9932-df064347324a service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:15.944256 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1370/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:15 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:30.748760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587277e7-b449-4660-b175-293959771254 service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:30.811163 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587277e7-b449-4660-b175-293959771254 service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:30.816595 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:30.817459 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:30.817765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:30.818046 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] PATH_INFO: `/v3/users/17b21cb78f634e5fbf37e9f187d948d5` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:30.819299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b21cb78f634e5fbf37e9f187d948d5)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:30.821284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:30.872974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b21cb78f634e5fbf37e9f187d948d5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:30.873623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b21cb78f634e5fbf37e9f187d948d5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:30.885259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b21cb78f634e5fbf37e9f187d948d5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:30.895206 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b21cb78f634e5fbf37e9f187d948d5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:30.895827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b21cb78f634e5fbf37e9f187d948d5'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:30.908029 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1406/2776] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:30 2021] DELETE /identity/v3/users/17b21cb78f634e5fbf37e9f187d948d5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:30.912856 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:30.913363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:30.913363 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:30.930507 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:30.931705 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:30.993223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1371/2777] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:31.005337 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:31.006789 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:31.065629 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b146b04-4ecb-4164-97b0-f913762f8385 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:31.069868 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:31.070517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:31.070798 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:31.071071 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:31.080602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:31.082041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:31.091517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1407/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 25 04:57:31.367883 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:31.369541 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:31.383231 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feded8-755e-474c-8546-d1e7997cc438 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:31.388366 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:31.389359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:31.389635 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:31.389893 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] PATH_INFO: `/v3/projects/a9c417daa7bb4ac4abfd5d6f9230294e` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:31.391110 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c417daa7bb4ac4abfd5d6f9230294e)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:31.393549 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:31.440033 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c417daa7bb4ac4abfd5d6f9230294e', 'request_id': 'req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.446474 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c417daa7bb4ac4abfd5d6f9230294e', 'request_id': 'req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.452907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c417daa7bb4ac4abfd5d6f9230294e', 'request_id': 'req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.468930 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] The token cache is being invalidate because project a9c417daa7bb4ac4abfd5d6f9230294e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:31.469218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.469880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.471614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1372/2779] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:31 2021] DELETE /identity/v3/projects/a9c417daa7bb4ac4abfd5d6f9230294e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:31.475956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:31.485857 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ede8d-461a-4197-b9a9-3d5c5d7c4514 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:31.554760 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:31.555654 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:31.555941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:31.556253 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] PATH_INFO: `/v3/users/dd49cad51eb04cc8a6a9f8de35767a42` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:31.557475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd49cad51eb04cc8a6a9f8de35767a42)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:31.559414 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:31.610976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd49cad51eb04cc8a6a9f8de35767a42'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.611670 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd49cad51eb04cc8a6a9f8de35767a42'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.623846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd49cad51eb04cc8a6a9f8de35767a42'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.633485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd49cad51eb04cc8a6a9f8de35767a42'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.634147 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-ce547b8b-2f6d-4ec4-844f-d1552ae98cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd49cad51eb04cc8a6a9f8de35767a42'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:31.646193 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1408/2780] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:31 2021] DELETE /identity/v3/users/dd49cad51eb04cc8a6a9f8de35767a42 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:31.991165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:31.992667 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:32.011702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0fa3-820c-4e0d-a7ad-c07532a4d43c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.078772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.079641 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.079934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.080311 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] PATH_INFO: `/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.081850 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b88cbc26b84e82896f8b7c2f81420d)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.083772 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.133105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b88cbc26b84e82896f8b7c2f81420d', 'request_id': 'req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:32.141653 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b88cbc26b84e82896f8b7c2f81420d', 'request_id': 'req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:32.148473 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b88cbc26b84e82896f8b7c2f81420d', 'request_id': 'req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:32.162851 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] The token cache is being invalidate because project b4b88cbc26b84e82896f8b7c2f81420d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:32.163142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:32.163759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-03ce07ea-6474-4ef3-9114-6b2bce60f1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:32.165372 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1373/2781] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:31 2021] DELETE /identity/v3/projects/b4b88cbc26b84e82896f8b7c2f81420d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:32.171187 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.171696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.171802 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.189759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:32.190958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:32.251887 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1409/2782] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:32.260313 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.260602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.260875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.280834 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:32.282045 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:32.292170 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1374/2783] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:32.296656 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.306944 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7aaac-74d8-478a-974f-94fbb92ed39e None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.312635 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.313324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.313593 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.313864 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.314599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:32.314904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.316504 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.328323 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1410/2784] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:32.332631 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.342142 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a93d21-21e2-418f-a2c4-e9fcaec6d19c None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.347877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.348569 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.348858 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.349133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.349838 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.351732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.381725 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1375/2785] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:32.386934 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.401761 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e746d2-c694-4e82-a369-a8f17b14e6c3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.462675 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.463331 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.463610 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.463886 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.464642 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.466571 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.489022 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1411/2786] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:57:32.493237 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.505002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848001-5378-4a78-8d40-990227cadf90 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.510894 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.511553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.511833 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.512100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.512880 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.514481 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.525742 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1376/2787] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:32.530143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.540972 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94293dd-1f02-4dce-a7e0-2d975e31bef6 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.546816 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.547530 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.547815 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.548088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.548863 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.550589 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1eb4-b8c7-450d-b716-390c910f6b0e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.560652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1412/2788] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:57:32.565105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.575907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e458-c516-43b4-9b0d-723802c884b4 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.581550 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.582609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.582916 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.583189 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] PATH_INFO: `/v3/projects/85141f2f5e604d2f9227c868bf20db65/users/da5f64427c9248db97203ca2910e7bc2/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.599420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85141f2f5e604d2f9227c868bf20db65, user_id=da5f64427c9248db97203ca2910e7bc2, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.602099 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.618410 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1377/2789] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:32 2021] PUT /identity/v3/projects/85141f2f5e604d2f9227c868bf20db65/users/da5f64427c9248db97203ca2910e7bc2/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:32.630380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.630669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.630949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.658461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] MFA Rules not processed for user `da5f64427c9248db97203ca2910e7bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:32.659682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:32.725458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1413/2790] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:32.730344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.800765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a0a39-fa98-4f65-afd0-41858d4bf26a admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.806648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.807332 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.807610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.807887 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.808645 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.810576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.851252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1378/2791] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:32.855506 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.868705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dad4fc-ab5c-4c28-bc68-6302b85b5070 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.929524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.930194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.930475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.930749 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.931452 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.933378 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.955175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1414/2792] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:32 2021] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:32.959698 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:32.970661 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8bd6-3808-4d2f-be68-387abe417270 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:32.975953 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:32.976724 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:32.977010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:32.977298 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:32.978044 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:32.979652 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:32.990428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1379/2793] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:32.994649 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.005403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084c18-ef75-4a38-be4a-bc12dd1f591e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.010288 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.011266 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.011618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.011893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] PATH_INFO: `/v3/projects/99ca83b67ff248c1b161c2ca907d7065/users/d5f0e5bdea4a4717af13448788b93731/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.027168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ca83b67ff248c1b161c2ca907d7065, user_id=d5f0e5bdea4a4717af13448788b93731, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.029867 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.044748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1415/2794] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:32 2021] PUT /identity/v3/projects/99ca83b67ff248c1b161c2ca907d7065/users/d5f0e5bdea4a4717af13448788b93731/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:33.048946 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.059437 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc94d-f40b-4a75-b6dc-0c2d51a5924e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.115292 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.115951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.116275 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.116553 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.117286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.118884 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9153-4f80-4909-951a-35f7bb7e4d89 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.128684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1380/2795] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 25 04:57:33.133284 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.144356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5195127-3d21-4522-b688-b75f73bb7492 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.150904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.151793 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.152077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.152373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] PATH_INFO: `/v3/projects/99ca83b67ff248c1b161c2ca907d7065/users/d5f0e5bdea4a4717af13448788b93731/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.154696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ca83b67ff248c1b161c2ca907d7065, user_id=d5f0e5bdea4a4717af13448788b93731, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.157426 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.168240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1416/2796] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:33 2021] PUT /identity/v3/projects/99ca83b67ff248c1b161c2ca907d7065/users/d5f0e5bdea4a4717af13448788b93731/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:33.183503 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.183877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.184252 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.214284 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] MFA Rules not processed for user `d5f0e5bdea4a4717af13448788b93731`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:33.215521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:33.285702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1381/2797] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:33 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:33.297129 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.300199 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:33.365264 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97872-76d4-4da2-89e1-73625cf1c298 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.369657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.370319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.370601 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.370873 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.381171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.382801 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492b5b0-88ff-40c6-b6e0-2837da7978de service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.392775 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1417/2798] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:33 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:33.420759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.482901 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28dfde-04ba-4ed3-8174-6c483da18760 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.487740 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.488658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.488941 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.489217 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] PATH_INFO: `/v3/users/da5f64427c9248db97203ca2910e7bc2` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.490439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5f64427c9248db97203ca2910e7bc2)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.492420 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.537863 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5f64427c9248db97203ca2910e7bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:33.538518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5f64427c9248db97203ca2910e7bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:33.554462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5f64427c9248db97203ca2910e7bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:33.562702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5f64427c9248db97203ca2910e7bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:33.573579 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5f64427c9248db97203ca2910e7bc2'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:33.581123 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1382/2799] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:33 2021] DELETE /identity/v3/users/da5f64427c9248db97203ca2910e7bc2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:33.586484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.587079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.587404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.608302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:33.609508 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:33.669897 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1418/2800] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:33.680246 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:33.681754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:33.741610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d32a7-68d0-472e-8ef6-0d533b6bd00c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:33.745331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:33.746005 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:33.746273 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:33.746548 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:33.755827 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:33.757289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:33.766702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1383/2801] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:34.070051 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:34.071904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:34.085188 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c35f7-50ad-4501-b3b7-ee85243d593c None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:34.091281 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:34.092704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.093081 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.093461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] PATH_INFO: `/v3/projects/85141f2f5e604d2f9227c868bf20db65` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.095053 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=85141f2f5e604d2f9227c868bf20db65)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:34.097737 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:34.149851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85141f2f5e604d2f9227c868bf20db65', 'request_id': 'req-60eab656-bc10-46f9-8e0f-caed2f458acd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.156055 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85141f2f5e604d2f9227c868bf20db65', 'request_id': 'req-60eab656-bc10-46f9-8e0f-caed2f458acd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.161902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85141f2f5e604d2f9227c868bf20db65', 'request_id': 'req-60eab656-bc10-46f9-8e0f-caed2f458acd'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.176012 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] The token cache is being invalidate because project 85141f2f5e604d2f9227c868bf20db65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:34.176282 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.176929 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.178736 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1419/2802] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:34 2021] DELETE /identity/v3/projects/85141f2f5e604d2f9227c868bf20db65 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:34.182648 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:34.192349 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4fa33-89de-4010-bae8-7ff81608953d service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:34.249250 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:34.250138 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.250429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.250704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] PATH_INFO: `/v3/users/d5f0e5bdea4a4717af13448788b93731` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.251925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f0e5bdea4a4717af13448788b93731)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:34.254430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:34.305280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f0e5bdea4a4717af13448788b93731'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.305951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f0e5bdea4a4717af13448788b93731'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.318119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f0e5bdea4a4717af13448788b93731'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.325318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f0e5bdea4a4717af13448788b93731'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.334889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1ad1c81c-4347-4c7f-bafd-ff82922cce79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f0e5bdea4a4717af13448788b93731'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.342134 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1384/2803] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:34 2021] DELETE /identity/v3/users/d5f0e5bdea4a4717af13448788b93731 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:34.628398 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:34.629975 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:34.644468 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eab656-bc10-46f9-8e0f-caed2f458acd admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:34.708389 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:34.709175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.709461 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.709770 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] PATH_INFO: `/v3/projects/99ca83b67ff248c1b161c2ca907d7065` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.712270 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ca83b67ff248c1b161c2ca907d7065)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:34.714345 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:34.763501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ca83b67ff248c1b161c2ca907d7065', 'request_id': 'req-54cacbea-15eb-448b-befa-6a2311108df7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.769880 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ca83b67ff248c1b161c2ca907d7065', 'request_id': 'req-54cacbea-15eb-448b-befa-6a2311108df7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.775394 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ca83b67ff248c1b161c2ca907d7065', 'request_id': 'req-54cacbea-15eb-448b-befa-6a2311108df7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.789140 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] The token cache is being invalidate because project 99ca83b67ff248c1b161c2ca907d7065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:34.789428 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.790077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-54cacbea-15eb-448b-befa-6a2311108df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:34.791794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1420/2804] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:34 2021] DELETE /identity/v3/projects/99ca83b67ff248c1b161c2ca907d7065 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:34.797748 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.798109 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.798480 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.817021 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:34.818239 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:34.878704 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1385/2805] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:34.886945 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.887233 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.887515 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.907631 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:34.909122 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:34.918463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1421/2806] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:34.922925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:34.933178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25259b9-496b-4772-95e1-91a381d3c4e6 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:34.938302 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:34.939629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.939629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.939992 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.940877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:34.941309 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:34.943100 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:34.955890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1386/2807] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:34.960648 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:34.970262 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbcbae-6227-48e3-aa8c-0b11770ffff7 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:34.975475 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:34.979038 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:34.979336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:34.979621 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:34.980404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:34.982327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.012788 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1422/2808] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:34 2021] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:35.014105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.031848 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be73d-c91c-446c-a6b4-31d9ce6bedc2 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.091837 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.092920 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.093205 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.093485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.094203 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.096175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.118424 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1387/2809] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:35.122913 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.133357 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf61be-845a-4403-9f7e-85af1f02adca admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.138252 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.138925 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.139222 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.139500 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.140388 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.142180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.153230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1423/2810] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:35.157368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.167955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b90dc4-50d9-4254-b5c2-50b88556188c admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.173151 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.173866 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.174175 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.174427 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.175178 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.176991 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564222a-3102-498e-a23d-17f7b16d4fb0 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.187601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1388/2811] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:35.192211 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.202647 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd85a4-9700-41c7-b7fc-1725887cc651 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.208125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.209112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.209397 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.209674 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] PATH_INFO: `/v3/projects/baa4e6aebb634eb68a45d024e6a3d654/users/378dd299acbd4228bf9de9073fc39877/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.225705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa4e6aebb634eb68a45d024e6a3d654, user_id=378dd299acbd4228bf9de9073fc39877, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.228318 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.244197 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1424/2812] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:35 2021] PUT /identity/v3/projects/baa4e6aebb634eb68a45d024e6a3d654/users/378dd299acbd4228bf9de9073fc39877/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:35.255886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.256208 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.256494 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.284990 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] MFA Rules not processed for user `378dd299acbd4228bf9de9073fc39877`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:35.286221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:35.354483 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1389/2813] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:35.359077 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.420446 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bc287-45c7-4c1f-867a-245bed2bea20 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.425519 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.426183 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.426462 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.426748 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.427447 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.429386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.456794 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1425/2814] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:35.461165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.473269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dac8a-62b0-4f9e-ad54-9a94463e80a0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.532119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.532877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.533267 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.533687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.534623 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.536676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.562799 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1390/2815] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:35.564175 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.580168 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4da4-e316-4b3a-a647-48cdd501381a admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.583623 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.584396 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.585313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.585612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.586653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.588385 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.603587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1426/2816] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:35.604906 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.615658 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd636-8027-41df-84b4-a215c36895cb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.620375 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.621039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.621325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.621597 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.622354 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.624060 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05aaec6-72b3-421c-8872-4018d32d8caa admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.634600 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1391/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:35.638943 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.649114 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54135e-6702-4548-ba73-d0b89bfc065b admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.654103 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.655015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.655309 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.655600 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] PATH_INFO: `/v3/projects/d0104f582352459783b70042e9364442/users/9779c1fac9904028a1f1b2b309062095/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.670745 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0104f582352459783b70042e9364442, user_id=9779c1fac9904028a1f1b2b309062095, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.673431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.688254 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1427/2818] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:35 2021] PUT /identity/v3/projects/d0104f582352459783b70042e9364442/users/9779c1fac9904028a1f1b2b309062095/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:35.698526 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.698844 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.699127 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.727300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] MFA Rules not processed for user `9779c1fac9904028a1f1b2b309062095`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:35.728593 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:35.796821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1392/2819] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:35.802039 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.863278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e9574-99e7-463c-a43a-896782e6e85e admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.868427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.869104 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.869390 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.869668 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.870410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.872351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.899280 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1428/2820] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:35.903627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:35.914734 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e711ab-348b-434f-944d-8b18e5cdab69 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:35.971000 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:35.971682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:35.971969 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:35.972280 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:35.973010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:35.974949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:35.997193 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1393/2821] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:35 2021] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:36.001302 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.012308 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8af0b7-6b00-4b89-adad-b5d006c1c955 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.018236 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.018927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.019215 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.019502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.020290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.022922 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.035963 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1429/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:36.040761 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.051650 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b9a0e-5a9f-4e27-bde9-3e4e91da0d9b admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.056495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.057389 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.057672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.057948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] PATH_INFO: `/v3/projects/6be7dd99aede4b8cb474ca174ac54861/users/266936b12d234479ab303b76bb45349a/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.082607 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be7dd99aede4b8cb474ca174ac54861, user_id=266936b12d234479ab303b76bb45349a, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.086113 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.103195 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1394/2823] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:36 2021] PUT /identity/v3/projects/6be7dd99aede4b8cb474ca174ac54861/users/266936b12d234479ab303b76bb45349a/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:36.107902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.120006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022036e4-4e4f-4b03-a253-472dbd7ba264 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.174660 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.175356 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.175638 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.176015 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.176817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.178412 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7974421-704a-4568-9eaa-d8d7cd1554bc admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.188403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1430/2824] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:36 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:36.193038 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.204174 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01bc23-96bd-46fc-9222-c55c93126607 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.209227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.210186 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.210465 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.210737 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] PATH_INFO: `/v3/projects/6be7dd99aede4b8cb474ca174ac54861/users/266936b12d234479ab303b76bb45349a/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.212766 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be7dd99aede4b8cb474ca174ac54861, user_id=266936b12d234479ab303b76bb45349a, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.215428 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.226554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1395/2825] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:36 2021] PUT /identity/v3/projects/6be7dd99aede4b8cb474ca174ac54861/users/266936b12d234479ab303b76bb45349a/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:36.237538 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.237820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.238095 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.264790 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] MFA Rules not processed for user `266936b12d234479ab303b76bb45349a`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:36.265997 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:36.332669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1431/2826] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:36 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:36.343775 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.346012 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:36.404687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223565-8be5-4191-a7ae-e13acc370c94 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.409382 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.410039 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.410325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.410599 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.419754 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.421224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.431015 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1396/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:36 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:36.474979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:36.476524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:36.489795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231b6fb-2adb-4229-8bcb-54d7e4dea4ba None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:36.494341 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:36.495052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:36.495313 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:36.495606 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:36.559181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:36.560693 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c03891-2e0b-4365-afce-a64274c5325a service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:36.570683 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1432/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:36 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:39.449964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:39.514972 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228859-7cb4-4a13-90fa-655fba1877ab service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:39.520269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:39.521200 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:39.521521 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:39.521805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] PATH_INFO: `/v3/users/378dd299acbd4228bf9de9073fc39877` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:39.523119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378dd299acbd4228bf9de9073fc39877)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:39.525119 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:39.577017 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378dd299acbd4228bf9de9073fc39877'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:39.577676 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378dd299acbd4228bf9de9073fc39877'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:39.591872 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378dd299acbd4228bf9de9073fc39877'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:39.599678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378dd299acbd4228bf9de9073fc39877'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:39.611333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378dd299acbd4228bf9de9073fc39877'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:39.621093 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1397/2829] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:39 2021] DELETE /identity/v3/users/378dd299acbd4228bf9de9073fc39877 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:39.628194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:39.628704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:39.628817 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:39.646750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:39.648192 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:39.710616 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1433/2830] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:39.721320 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:39.722902 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:39.784058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a792-a063-4a65-beec-53f2f15d1255 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:39.788512 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:39.789173 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:39.789463 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:39.789745 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:39.799028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:39.800509 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:39.810261 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1398/2831] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:40.085795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:40.087304 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:40.102026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbdc0d-cac1-4df9-8426-1d59d4bda822 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:40.107835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:40.108738 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:40.109000 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:40.109273 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] PATH_INFO: `/v3/projects/baa4e6aebb634eb68a45d024e6a3d654` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:40.110607 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa4e6aebb634eb68a45d024e6a3d654)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:40.113430 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:40.166686 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa4e6aebb634eb68a45d024e6a3d654', 'request_id': 'req-06b9bf8a-5084-4973-93d4-d925ab0a0854'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.173184 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa4e6aebb634eb68a45d024e6a3d654', 'request_id': 'req-06b9bf8a-5084-4973-93d4-d925ab0a0854'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.179117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa4e6aebb634eb68a45d024e6a3d654', 'request_id': 'req-06b9bf8a-5084-4973-93d4-d925ab0a0854'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.194904 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] The token cache is being invalidate because project baa4e6aebb634eb68a45d024e6a3d654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:40.195181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.195851 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.197457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1434/2832] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:40 2021] DELETE /identity/v3/projects/baa4e6aebb634eb68a45d024e6a3d654 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:40.201575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:40.212426 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8caa8b-3105-4b7b-a7ba-82f37cccd116 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:40.269765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:40.270680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:40.270950 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:40.271245 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] PATH_INFO: `/v3/users/9779c1fac9904028a1f1b2b309062095` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:40.272636 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9779c1fac9904028a1f1b2b309062095)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:40.274643 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:40.327637 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9779c1fac9904028a1f1b2b309062095'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.328300 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9779c1fac9904028a1f1b2b309062095'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.340684 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9779c1fac9904028a1f1b2b309062095'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.348492 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9779c1fac9904028a1f1b2b309062095'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.358938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9779c1fac9904028a1f1b2b309062095'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.365334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1399/2833] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:40 2021] DELETE /identity/v3/users/9779c1fac9904028a1f1b2b309062095 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:40.637043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:40.638524 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:40.652796 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf8a-5084-4973-93d4-d925ab0a0854 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:40.708516 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:40.709403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:40.709705 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:40.710269 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] PATH_INFO: `/v3/projects/d0104f582352459783b70042e9364442` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:40.711582 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0104f582352459783b70042e9364442)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:40.713522 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:40.767181 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0104f582352459783b70042e9364442', 'request_id': 'req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.774290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0104f582352459783b70042e9364442', 'request_id': 'req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.780463 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0104f582352459783b70042e9364442', 'request_id': 'req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.794586 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] The token cache is being invalidate because project d0104f582352459783b70042e9364442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:40.794884 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.795626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.797457 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1435/2834] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:40 2021] DELETE /identity/v3/projects/d0104f582352459783b70042e9364442 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:40.801679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:40.803223 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:40.816582 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488fb3f-b61a-4cac-83f2-4b369fd4cfca admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:40.874378 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:40.875315 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:40.875601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:40.875877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] PATH_INFO: `/v3/users/266936b12d234479ab303b76bb45349a` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:40.877285 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266936b12d234479ab303b76bb45349a)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:40.879331 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:40.927282 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266936b12d234479ab303b76bb45349a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.927925 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266936b12d234479ab303b76bb45349a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.940768 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266936b12d234479ab303b76bb45349a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.947755 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266936b12d234479ab303b76bb45349a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.957594 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-9fc0abe4-528b-4e0c-98de-cdb942a59086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266936b12d234479ab303b76bb45349a'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:40.964034 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1400/2835] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:40 2021] DELETE /identity/v3/users/266936b12d234479ab303b76bb45349a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:41.247754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.249343 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:41.262806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33034f9b-ebaf-4a4f-b7a7-e8993afc47f7 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.323553 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.324473 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.324759 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.325041 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] PATH_INFO: `/v3/projects/6be7dd99aede4b8cb474ca174ac54861` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.326230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be7dd99aede4b8cb474ca174ac54861)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.328171 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.376127 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be7dd99aede4b8cb474ca174ac54861', 'request_id': 'req-a02a6ac3-ba9d-4131-b744-62b9340f026b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:41.382551 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be7dd99aede4b8cb474ca174ac54861', 'request_id': 'req-a02a6ac3-ba9d-4131-b744-62b9340f026b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:41.387977 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be7dd99aede4b8cb474ca174ac54861', 'request_id': 'req-a02a6ac3-ba9d-4131-b744-62b9340f026b'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:41.401928 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] The token cache is being invalidate because project 6be7dd99aede4b8cb474ca174ac54861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:41.402194 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:41.402823 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-a02a6ac3-ba9d-4131-b744-62b9340f026b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:41.404405 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1436/2836] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:41 2021] DELETE /identity/v3/projects/6be7dd99aede4b8cb474ca174ac54861 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:41.411469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.411759 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.412040 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.430551 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:41.431702 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:41.492268 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1401/2837] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:41.501092 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.501380 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.501659 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.521836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:41.523231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:41.531902 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1437/2838] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:41.536441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.546965 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba60f-57d4-4752-ac3e-756039ecd260 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.551632 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.552318 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.552602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.552879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] PATH_INFO: `/v3/domains` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.553692 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:41.554010 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.555629 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.567453 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1402/2839] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:41.572574 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.582006 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9b98-a1fe-4246-bd8e-b0c4fe76fde8 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.587492 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.588176 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.589366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.589366 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.590117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.591990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.620966 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1438/2840] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:41.625469 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.635557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce03c21-c7c6-4fbf-817e-ae1e3ff9437d admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.691159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.691738 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.692028 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.692341 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.693054 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.695041 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.722095 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1403/2841] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:41.726542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.737279 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450074-8d9e-488c-896a-0cea1cb32c2c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.743293 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.743974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.744290 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.744588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.745386 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.746980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.758142 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1439/2842] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:41.762269 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.773385 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5902e-a493-43b2-b034-a79569505fcb admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.780002 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.780733 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.781016 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.781286 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.782018 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.783602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8625f-7ea8-4f2a-85e2-84945c01cfc6 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.795145 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1404/2843] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:41.800080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:41.816177 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaecb9-a8cf-4bf5-a72b-ad4709800029 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:41.823458 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:41.824406 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.824689 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.824973 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] PATH_INFO: `/v3/projects/90d37e99fbf14268a4552ef7e1dc9319/users/c878bb3802404c80ae49efc02b6bb979/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.841680 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d37e99fbf14268a4552ef7e1dc9319, user_id=c878bb3802404c80ae49efc02b6bb979, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:41.846899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:41.861764 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1440/2844] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:41 2021] PUT /identity/v3/projects/90d37e99fbf14268a4552ef7e1dc9319/users/c878bb3802404c80ae49efc02b6bb979/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:41.872907 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d724-309c-419a-9673-b30127f0352b None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:41.873394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d724-309c-419a-9673-b30127f0352b None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:41.873609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d724-309c-419a-9673-b30127f0352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:41.900687 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-4e39d724-309c-419a-9673-b30127f0352b None None] MFA Rules not processed for user `c878bb3802404c80ae49efc02b6bb979`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:41.901908 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-4e39d724-309c-419a-9673-b30127f0352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:41.972450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1405/2845] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:41.977054 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.040327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6c58-37e9-4cd9-bfbc-3ff4e8477e91 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.045498 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.046207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.046495 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.046777 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] PATH_INFO: `/v3/projects` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.047526 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.049490 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.080704 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1441/2846] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:41 2021] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:42.081913 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d724-309c-419a-9673-b30127f0352b None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.094760 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d724-309c-419a-9673-b30127f0352b None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.153879 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.154555 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.154839 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.155115 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.155955 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.157988 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.179513 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1406/2847] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:42 2021] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:57:42.183765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.194185 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e392956-e89c-4cfc-943f-4a0e6c97e166 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.198676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.199336 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.199620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.199949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.200676 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.202476 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.214765 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1442/2848] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:42.219430 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.229806 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b991a-ad3b-475d-8b0f-258b84a44fa9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.235080 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.236220 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.237105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.237105 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] PATH_INFO: `/v3/projects/258198527ec64178b1fe6cc532551a24/users/b16f17e691394028acec40bb7afbac1c/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.252948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258198527ec64178b1fe6cc532551a24, user_id=b16f17e691394028acec40bb7afbac1c, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.255609 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.271621 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1407/2849] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:42 2021] PUT /identity/v3/projects/258198527ec64178b1fe6cc532551a24/users/b16f17e691394028acec40bb7afbac1c/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:42.276469 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.287402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fab0-53a4-41cc-905a-cca3f7939434 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.356820 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.357494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.357795 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.358068 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.358808 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.360442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac474d8-dfa6-4a67-80d9-35f63555735d admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.370980 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1443/2850] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:42.376179 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.387608 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3809f2-5ec8-43cb-9cbb-25fa8e9ec104 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.393395 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.394283 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.394565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.394835 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] PATH_INFO: `/v3/projects/258198527ec64178b1fe6cc532551a24/users/b16f17e691394028acec40bb7afbac1c/roles/5a566cc358594cd0bc74d7f1067c85bc` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.396985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=258198527ec64178b1fe6cc532551a24, user_id=b16f17e691394028acec40bb7afbac1c, role_id=5a566cc358594cd0bc74d7f1067c85bc)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.399864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.410820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1408/2851] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:42 2021] PUT /identity/v3/projects/258198527ec64178b1fe6cc532551a24/users/b16f17e691394028acec40bb7afbac1c/roles/5a566cc358594cd0bc74d7f1067c85bc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:42.423067 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.423332 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.423633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.451484 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] MFA Rules not processed for user `b16f17e691394028acec40bb7afbac1c`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:42.452678 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:42.539300 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1444/2852] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:42 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:42.550731 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:42.552910 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:42.613805 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865281ac-20e0-4d55-95f7-677e4b336f2e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:42.618490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:42.619333 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:42.619756 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:42.620124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:42.631240 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:42.632982 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53e6f9-b0f1-47b5-aa70-9d246da8c33f service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:42.642674 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1409/2853] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:42 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:42.977703 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:43.040425 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ea7b-b9d7-457c-ab15-921fac7832dd None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:43.046768 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:43.047652 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:43.047932 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:43.048218 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] PATH_INFO: `/v3/users/c878bb3802404c80ae49efc02b6bb979` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:43.049501 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c878bb3802404c80ae49efc02b6bb979)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:43.051542 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:43.101920 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c878bb3802404c80ae49efc02b6bb979'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.102579 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c878bb3802404c80ae49efc02b6bb979'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.115472 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c878bb3802404c80ae49efc02b6bb979'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.123732 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c878bb3802404c80ae49efc02b6bb979'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.124399 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c878bb3802404c80ae49efc02b6bb979'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.137442 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1445/2854] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:42 2021] DELETE /identity/v3/users/c878bb3802404c80ae49efc02b6bb979 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:43.142288 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:43.142781 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:43.142889 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:43.160951 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:43.162346 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:43.222265 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1410/2855] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:43.233410 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:43.234839 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:43.293497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949684-6bfd-4014-98fe-0c560cd4c8b3 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:43.297283 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:43.297955 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:43.298240 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:43.298523 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:43.308927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:43.310758 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:43.321434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1446/2856] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:43.594345 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:43.595993 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:43.608482 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9cce5-b13b-45c1-a2ab-dfc3d4a499c0 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:43.613644 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:43.614610 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:43.615079 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:43.615355 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] PATH_INFO: `/v3/projects/90d37e99fbf14268a4552ef7e1dc9319` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:43.616655 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d37e99fbf14268a4552ef7e1dc9319)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:43.618590 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:43.671999 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d37e99fbf14268a4552ef7e1dc9319', 'request_id': 'req-0770630f-4689-4a14-aa3c-dd2ded3ea891'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.678326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d37e99fbf14268a4552ef7e1dc9319', 'request_id': 'req-0770630f-4689-4a14-aa3c-dd2ded3ea891'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.684077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d37e99fbf14268a4552ef7e1dc9319', 'request_id': 'req-0770630f-4689-4a14-aa3c-dd2ded3ea891'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.698598 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] The token cache is being invalidate because project 90d37e99fbf14268a4552ef7e1dc9319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:43.698890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.699642 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.701454 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1411/2857] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:43 2021] DELETE /identity/v3/projects/90d37e99fbf14268a4552ef7e1dc9319 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:43.705651 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:43.715585 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b7f19-903e-4eb7-bbcd-efb59fc1591c service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:43.772939 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:43.773728 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:43.774007 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:43.774278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] PATH_INFO: `/v3/users/b16f17e691394028acec40bb7afbac1c` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:43.775612 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16f17e691394028acec40bb7afbac1c)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:43.777550 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:43.826558 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16f17e691394028acec40bb7afbac1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.827292 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16f17e691394028acec40bb7afbac1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.840267 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16f17e691394028acec40bb7afbac1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.849250 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16f17e691394028acec40bb7afbac1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.849835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-1b361d07-0b33-4d0b-a115-e1bbb5677708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16f17e691394028acec40bb7afbac1c'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:43.862294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1447/2858] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:43 2021] DELETE /identity/v3/users/b16f17e691394028acec40bb7afbac1c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:44.136574 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.138091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:44.151435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770630f-4689-4a14-aa3c-dd2ded3ea891 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.207821 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.208767 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.209053 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.209360 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] PATH_INFO: `/v3/projects/258198527ec64178b1fe6cc532551a24` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.211423 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258198527ec64178b1fe6cc532551a24)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.213444 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.263618 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258198527ec64178b1fe6cc532551a24', 'request_id': 'req-1610abaa-d5d4-48e4-bd54-10279cf9b128'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:44.269672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258198527ec64178b1fe6cc532551a24', 'request_id': 'req-1610abaa-d5d4-48e4-bd54-10279cf9b128'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:44.275876 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258198527ec64178b1fe6cc532551a24', 'request_id': 'req-1610abaa-d5d4-48e4-bd54-10279cf9b128'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:44.295141 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] The token cache is being invalidate because project 258198527ec64178b1fe6cc532551a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:44.295602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:44.296688 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-1610abaa-d5d4-48e4-bd54-10279cf9b128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:44.299227 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1412/2859] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:44 2021] DELETE /identity/v3/projects/258198527ec64178b1fe6cc532551a24 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:44.307276 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.307797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.307797 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.326599 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:44.327806 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:44.392298 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1448/2860] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:44.402485 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.402783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.403063 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.424422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:44.425718 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:44.434934 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1413/2861] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:44.439226 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.449085 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fb6bd-ae3a-45c9-b996-ca979975c7ed None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.454981 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.455646 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.455927 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.456195 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.456958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:44.457259 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.458836 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.471995 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1449/2862] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 25 04:57:44.476859 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.486221 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713fdd8-e3bd-46e9-9fb7-374029ea4402 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.491722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.492419 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.492700 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.492964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.493689 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.495573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.526587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1414/2863] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:44 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:44.528102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.538353 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c41d26-11ea-4878-885e-64a4d9553c26 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.595959 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.596677 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.596957 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.597231 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.597990 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.600827 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.624669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1450/2864] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:44 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:44.628860 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.640065 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6d75-a147-4e7d-b8f7-ade1ff1c3493 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.645335 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.646058 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.646339 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.646613 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.647416 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.649077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.659209 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1415/2865] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:44.663088 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.673537 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8da7e-17ae-4874-97a0-f66f4708bb48 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.680384 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.681079 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.681363 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.681620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.682369 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.684003 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df6672-ec8a-45b1-a9ae-e81b04461b6f admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.695217 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1451/2866] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:44.699489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.709343 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331fd41-1829-4a70-a208-35b11b89b4e9 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.714390 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.715248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.715523 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.715776 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] PATH_INFO: `/v3/projects/831ce56bc1b444fda201583d945b96ab/users/c94a0ace0f144ca39015e101d576b228/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.730937 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=831ce56bc1b444fda201583d945b96ab, user_id=c94a0ace0f144ca39015e101d576b228, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.733625 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.749727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1416/2867] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:44 2021] PUT /identity/v3/projects/831ce56bc1b444fda201583d945b96ab/users/c94a0ace0f144ca39015e101d576b228/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:57:44.760327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.760620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.760891 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.787555 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] MFA Rules not processed for user `c94a0ace0f144ca39015e101d576b228`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:44.788956 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:44.860949 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1452/2868] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:44.871677 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:44.873530 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:44.933489 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4899ea0-0073-4a02-b002-d86c7a03fd8f admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:44.937529 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:44.938165 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:44.938448 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:44.938722 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:44.947911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:44.949369 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723673a6-7774-4470-bfc1-e7d050c62b36 service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:44.958066 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1417/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:44 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:44.984239 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.061597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941d60-9aec-45c8-8006-e466491c6245 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:45.067387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:45.068299 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.068588 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.068858 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] PATH_INFO: `/v3/users/c94a0ace0f144ca39015e101d576b228` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.070379 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94a0ace0f144ca39015e101d576b228)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:45.072326 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:45.121020 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94a0ace0f144ca39015e101d576b228'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.121633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94a0ace0f144ca39015e101d576b228'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.133403 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94a0ace0f144ca39015e101d576b228'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.141861 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94a0ace0f144ca39015e101d576b228'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.142491 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94a0ace0f144ca39015e101d576b228'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.154809 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1453/2870] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:57:44 2021] DELETE /identity/v3/users/c94a0ace0f144ca39015e101d576b228 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:45.159538 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.160114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.160114 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.178368 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:45.179735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:45.241974 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1418/2871] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:45.251976 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.253617 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:45.311131 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23048f-3673-4a2f-a3f9-659c8bcf5c19 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:45.314893 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:45.315541 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.315821 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.316091 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.325364 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:45.327219 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419f8d-cf15-48a4-a1f5-60ab1d33c61b service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:45.336807 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1454/2872] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:57:45.618460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.620450 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:45.638029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cba41-a038-4b3b-a2de-013fce38f90e None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:45.654128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:45.655732 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.656077 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.656495 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] PATH_INFO: `/v3/projects/831ce56bc1b444fda201583d945b96ab` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.657943 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831ce56bc1b444fda201583d945b96ab)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:45.659960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:45.712417 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831ce56bc1b444fda201583d945b96ab', 'request_id': 'req-7645cc91-1d72-4277-9e24-55ee7f671219'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.720103 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831ce56bc1b444fda201583d945b96ab', 'request_id': 'req-7645cc91-1d72-4277-9e24-55ee7f671219'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.726626 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831ce56bc1b444fda201583d945b96ab', 'request_id': 'req-7645cc91-1d72-4277-9e24-55ee7f671219'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.745048 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] The token cache is being invalidate because project 831ce56bc1b444fda201583d945b96ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:57:45.745585 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.746506 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-7645cc91-1d72-4277-9e24-55ee7f671219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:57:45.748602 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1419/2873] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:57:45 2021] DELETE /identity/v3/projects/831ce56bc1b444fda201583d945b96ab => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:45.754620 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.755002 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.755278 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.772899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:45.774180 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:45.841557 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1455/2874] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:45.851133 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.851412 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.851673 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.870710 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:45.871895 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:45.880358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1420/2875] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:57:45.884657 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.895106 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eb07e-37dd-434a-b6f7-9b210c25e38d None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:45.900641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:45.901314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.901564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.901833 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.902567 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 25 04:57:45.902874 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:45.904470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:45.919235 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1456/2876] 10.222.0.36 () {58 vars in 1152 bytes} [Thu Nov 25 04:57:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 25 04:57:45.923820 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.933603 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a9d20-7b2f-47db-883b-ff6cf0612a7d None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:45.939394 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:45.940057 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:45.940388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:45.940665 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] PATH_INFO: `/v3/projects` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:45.941422 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:45.943359 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:45.973558 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1421/2877] 10.222.0.36 () {60 vars in 1152 bytes} [Thu Nov 25 04:57:45 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 25 04:57:45.977941 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:45.988344 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481adf-61e7-4dce-9a7c-a623e1fa0e90 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:46.044174 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:46.045026 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.045305 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.045572 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.046327 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:46.048387 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:46.073314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1457/2878] 10.222.0.36 () {60 vars in 1143 bytes} [Thu Nov 25 04:57:45 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 25 04:57:46.080029 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:46.091460 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1913a7-9466-4787-bf70-27931ccbaf58 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:46.097274 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:46.097949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.098358 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.098660 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.099554 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:46.101746 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:46.116299 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1422/2879] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:46.117465 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:46.127847 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32234b32-d9d5-47bc-a335-865e75fce5f1 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:46.133618 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:46.134121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.134393 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.134669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.135439 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:46.137117 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49af69-3269-464e-8609-fb6da4f40e42 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:46.147633 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1458/2880] 10.222.0.36 () {58 vars in 1121 bytes} [Thu Nov 25 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 25 04:57:46.151773 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:46.161711 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479064d-ea11-4e5b-a989-40be862b7ca5 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:46.167206 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:46.168498 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.168792 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.169116 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] PATH_INFO: `/v3/projects/db34f259542b4216ad276a71dd9d8dae/users/68fe0a5e64e846feaeba78591fe25faa/roles/7a34713434094c19b43446fca1e27cf7` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.185911 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db34f259542b4216ad276a71dd9d8dae, user_id=68fe0a5e64e846feaeba78591fe25faa, role_id=7a34713434094c19b43446fca1e27cf7)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:46.189124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:46.204124 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1423/2881] 10.222.0.36 () {60 vars in 1482 bytes} [Thu Nov 25 04:57:46 2021] PUT /identity/v3/projects/db34f259542b4216ad276a71dd9d8dae/users/68fe0a5e64e846feaeba78591fe25faa/roles/7a34713434094c19b43446fca1e27cf7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:57:46.214767 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a3085-0bc4-4196-a0d6-4b21bd36787a None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.215413 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a3085-0bc4-4196-a0d6-4b21bd36787a None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.215750 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a3085-0bc4-4196-a0d6-4b21bd36787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.243799 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-2e0a3085-0bc4-4196-a0d6-4b21bd36787a None None] MFA Rules not processed for user `68fe0a5e64e846feaeba78591fe25faa`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:57:46.245043 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-2e0a3085-0bc4-4196-a0d6-4b21bd36787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:46.308275 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1459/2882] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:57:46 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:57:46.319696 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:57:46.321758 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:57:46.381573 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d875-f3f8-45e4-9191-dbe1c8b47b47 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:57:46.386462 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:57:46.387128 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:57:46.387405 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:57:46.387680 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:57:46.396764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:57:46.398663 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:57:46.407765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1424/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:57:46 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:58:00.653597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] REQUEST_METHOD: `POST` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:00.654301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:00.654301 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:00.683753 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.auth.core [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] MFA Rules not processed for user `a70b4ceee58f432c83bc2c1137ecc537`. Rule list: `[]` (Enabled: `True`). {{(pid=85551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:58:00.685289 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:00.743373 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1460/2884] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:58:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:58:08.388325 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:08.389857 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:08.445218 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f158-3334-4359-b4bf-fe913244e88f service cinder] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:08.449476 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:08.450129 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:08.450409 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:08.450675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:08.452727 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:08.534898 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:08.536374 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1bb8d-d680-4f86-9287-e80420c65855 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:08.547381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1425/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:58:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:58:11.332112 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:11.395989 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230606-e61e-475d-bf14-e09bf56a6c76 None None] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:11.400964 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:11.401843 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:11.402124 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:11.402402 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] PATH_INFO: `/v3/users/68fe0a5e64e846feaeba78591fe25faa` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:11.403641 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fe0a5e64e846feaeba78591fe25faa)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:11.405662 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:11.456556 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fe0a5e64e846feaeba78591fe25faa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:11.457773 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fe0a5e64e846feaeba78591fe25faa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:11.470100 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fe0a5e64e846feaeba78591fe25faa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:11.478190 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fe0a5e64e846feaeba78591fe25faa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:11.479098 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fe0a5e64e846feaeba78591fe25faa'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:11.492438 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1461/2886] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:58:11 2021] DELETE /identity/v3/users/68fe0a5e64e846feaeba78591fe25faa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:58:11.497290 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:11.497765 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:11.497877 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:11.515614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] MFA Rules not processed for user `413d9d96bebe4a659dd26ecc16805343`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:58:11.516890 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:11.578475 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1426/2887] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:58:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 25 04:58:11.588713 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:11.590467 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:11.649819 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37418-39c6-4dd4-804a-c82c85914572 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:11.653772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:11.654431 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:11.654714 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:11.654986 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:11.665213 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:11.666653 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:11.676143 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1462/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:58:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:58:11.952964 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:11.954565 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:11.968736 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb004-a1bf-419d-9986-10d0a309c0be None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:11.974747 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:11.975627 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:11.975944 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:11.976241 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] PATH_INFO: `/v3/projects/db34f259542b4216ad276a71dd9d8dae` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:11.977557 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db34f259542b4216ad276a71dd9d8dae)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:11.979490 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:12.031377 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db34f259542b4216ad276a71dd9d8dae', 'request_id': 'req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:12.037762 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db34f259542b4216ad276a71dd9d8dae', 'request_id': 'req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:12.043717 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db34f259542b4216ad276a71dd9d8dae', 'request_id': 'req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:12.057874 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] The token cache is being invalidate because project db34f259542b4216ad276a71dd9d8dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:58:12.058167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:12.058787 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:58:12.060449 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1427/2889] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:58:11 2021] DELETE /identity/v3/projects/db34f259542b4216ad276a71dd9d8dae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 25 04:58:12.124189 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:12.126404 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:12.145639 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ea56-966c-4e40-b4a6-5fac5a9a6d70 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:12.198517 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:12.199208 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:12.199497 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:12.199779 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:12.201846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:12.281577 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:12.282937 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:12.295411 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1463/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:58:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:58:28.281388 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:58:28.283091 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:28.297167 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b266c7-4f18-4568-8941-a1d8bb5b9b5e admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:58:28.301248 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:58:28.301904 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:58:28.302192 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:58:28.302477 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:58:28.304381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:58:28.314135 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:58:28.315576 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:58:28.323714 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1428/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:58:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:59:03.306951 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:03.308626 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:03.374427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b693ba-db60-4c8e-9ce4-0847bd6bf3f3 service neutron] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:03.379207 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:03.380125 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:03.380434 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:03.380700 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] PATH_INFO: `/v3/users/a70b4ceee58f432c83bc2c1137ecc537` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:03.381926 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70b4ceee58f432c83bc2c1137ecc537)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:03.383896 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:03.432485 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70b4ceee58f432c83bc2c1137ecc537'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.433101 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70b4ceee58f432c83bc2c1137ecc537'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.445597 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70b4ceee58f432c83bc2c1137ecc537'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.456449 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70b4ceee58f432c83bc2c1137ecc537'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.457166 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70b4ceee58f432c83bc2c1137ecc537'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.470080 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1464/2892] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 04:59:03 2021] DELETE /identity/v3/users/a70b4ceee58f432c83bc2c1137ecc537 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:59:03.661914 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:03.673938 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8f7eb-3810-43ac-9f07-3e5ea3e92522 service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:03.733975 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:03.734875 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:03.735159 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:03.735439 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] PATH_INFO: `/v3/projects/f2fc92afbcbd4ebcad522e660bb5e8da` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:03.736672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2fc92afbcbd4ebcad522e660bb5e8da)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:03.738595 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:03.788468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fc92afbcbd4ebcad522e660bb5e8da', 'request_id': 'req-d75d7864-3b47-4cec-842b-0a7e0a453cb4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.794945 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fc92afbcbd4ebcad522e660bb5e8da', 'request_id': 'req-d75d7864-3b47-4cec-842b-0a7e0a453cb4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.800564 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fc92afbcbd4ebcad522e660bb5e8da', 'request_id': 'req-d75d7864-3b47-4cec-842b-0a7e0a453cb4'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.814468 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] The token cache is being invalidate because project f2fc92afbcbd4ebcad522e660bb5e8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 04:59:03.814735 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.815381 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-d75d7864-3b47-4cec-842b-0a7e0a453cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 04:59:03.816981 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1429/2893] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 04:59:03 2021] DELETE /identity/v3/projects/f2fc92afbcbd4ebcad522e660bb5e8da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 04:59:22.426225 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:22.427899 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:22.489121 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8c43-6bf1-49db-98ae-38cd5df3097c admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:22.540102 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '140bf1d478d74252a94ab359064731dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:22.540835 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:22.541113 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:22.541370 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:22.543624 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:22.607314 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:22.608853 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:22.618319 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1465/2894] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:59:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:59:29.489362 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] REQUEST_METHOD: `POST` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:29.489960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:29.489960 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:29.509247 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.auth.core [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] MFA Rules not processed for user `32542b8b0e454a1ba0e1e18a9cf4dd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=85552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 25 04:59:29.510435 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:29.517672 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1430/2895] 10.222.0.36 () {58 vars in 957 bytes} [Thu Nov 25 04:59:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 25 04:59:36.838841 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:36.840667 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:36.936682 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5c580-d78b-428e-a75c-5b89babaa17c service cinder] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:36.942494 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:36.943261 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:36.943669 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:36.944037 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:36.946069 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:36.961063 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:36.962870 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:36.976915 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1466/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:59:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:59:48.062204 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:48.064027 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:48.083326 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe668-c48d-4292-a108-3d01bc44e271 None None] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:48.088980 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:48.089649 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:48.089926 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:48.090682 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:48.092584 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:48.105007 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:48.106614 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:48.117699 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1431/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:59:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 04:59:52.360052 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 04:59:52.376958 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff81f51-b036-491f-9d89-30f9b3aaf6ce service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 04:59:52.383564 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a5832639148459ca8895ae9e26e4b1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 04:59:52.384351 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 04:59:52.384698 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 04:59:52.384982 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 04:59:52.387382 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 04:59:52.400619 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 04:59:52.402324 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 04:59:52.414294 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1467/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 04:59:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 05:01:33.935864 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:01:33.937601 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:01:34.054870 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed785-119b-423e-8be0-f5836234a475 service nova] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:01:34.059072 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f881943403942878b4ac80e11c2f5a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:01:34.059749 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] REQUEST_METHOD: `GET` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:01:34.060531 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:01:34.060808 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:01:34.062985 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:01:34.190783 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:01:34.192191 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:01:34.212276 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1432/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 05:01:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 25 05:01:40.932513 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:01:40.934587 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:01:40.990499 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6399b-e9d3-458d-9971-ac170fe587fd service nova] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:01:40.995167 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:01:40.996057 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:01:40.996376 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:01:40.996650 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] PATH_INFO: `/v3/users/32542b8b0e454a1ba0e1e18a9cf4dd7d` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:01:40.997974 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=32542b8b0e454a1ba0e1e18a9cf4dd7d)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:01:40.999894 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:01:41.047502 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32542b8b0e454a1ba0e1e18a9cf4dd7d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.048242 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32542b8b0e454a1ba0e1e18a9cf4dd7d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.061130 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32542b8b0e454a1ba0e1e18a9cf4dd7d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.070731 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32542b8b0e454a1ba0e1e18a9cf4dd7d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.071470 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32542b8b0e454a1ba0e1e18a9cf4dd7d'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.084772 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1468/2900] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 05:01:40 2021] DELETE /identity/v3/users/32542b8b0e454a1ba0e1e18a9cf4dd7d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 05:01:41.274675 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:01:41.290949 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571440d-e0ee-4d41-8c0b-9985392efcce service neutron] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:01:41.351886 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:01:41.352701 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:01:41.352948 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:01:41.353238 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] PATH_INFO: `/v3/projects/8522662999744d00a4b23e041e4ada60` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:01:41.354466 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8522662999744d00a4b23e041e4ada60)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:01:41.356441 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:01:41.402289 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8522662999744d00a4b23e041e4ada60', 'request_id': 'req-ded89088-d29a-4f97-bfc4-012c98b36138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.408778 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8522662999744d00a4b23e041e4ada60', 'request_id': 'req-ded89088-d29a-4f97-bfc4-012c98b36138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.414334 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8522662999744d00a4b23e041e4ada60', 'request_id': 'req-ded89088-d29a-4f97-bfc4-012c98b36138'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.427881 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] The token cache is being invalidate because project 8522662999744d00a4b23e041e4ada60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 05:01:41.428222 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.428867 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.430511 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1433/2901] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 05:01:41 2021] DELETE /identity/v3/projects/8522662999744d00a4b23e041e4ada60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 05:01:41.435296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:01:41.436681 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:01:41.450230 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ecfa-ad03-4ded-a8ca-af759f2ea2ce admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:01:41.514722 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:01:41.515979 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:01:41.516342 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:01:41.516724 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] PATH_INFO: `/v3/users/c8d020f7bc7a4884a7c1be038aab76d7` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:01:41.518754 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d020f7bc7a4884a7c1be038aab76d7)` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:01:41.521846 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:01:41.577751 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d020f7bc7a4884a7c1be038aab76d7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.578427 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d020f7bc7a4884a7c1be038aab76d7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.591296 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d020f7bc7a4884a7c1be038aab76d7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.599711 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d020f7bc7a4884a7c1be038aab76d7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.600488 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.notifications [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d020f7bc7a4884a7c1be038aab76d7'} {{(pid=85551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.612752 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1469/2902] 10.222.0.36 () {58 vars in 1223 bytes} [Thu Nov 25 05:01:41 2021] DELETE /identity/v3/users/c8d020f7bc7a4884a7c1be038aab76d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 05:01:41.793861 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Authenticating user token {{(pid=85552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:01:41.795587 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.fernet_utils [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:01:41.809518 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89088-d29a-4f97-bfc4-012c98b36138 admin admin] Validating token access rules against request {{(pid=85552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:01:41.867831 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413d9d96bebe4a659dd26ecc16805343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eecafb0e45fb4de69b43e46178412ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:01:41.868678 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:01:41.868958 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:01:41.869224 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] PATH_INFO: `/v3/projects/4b2fbc33d10047668d8743369cb2f442` {{(pid=85552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:01:41.870456 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2fbc33d10047668d8743369cb2f442)` {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:01:41.872575 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] RBAC: Authorization granted {{(pid=85552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:01:41.920679 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2fbc33d10047668d8743369cb2f442', 'request_id': 'req-8bc04df0-a765-478e-8b56-c4d6ff561e6d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.926429 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2fbc33d10047668d8743369cb2f442', 'request_id': 'req-8bc04df0-a765-478e-8b56-c4d6ff561e6d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.931954 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2fbc33d10047668d8743369cb2f442', 'request_id': 'req-8bc04df0-a765-478e-8b56-c4d6ff561e6d'} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.945344 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] The token cache is being invalidate because project 4b2fbc33d10047668d8743369cb2f442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 25 05:01:41.945619 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.946225 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: DEBUG keystone.notifications [None req-8bc04df0-a765-478e-8b56-c4d6ff561e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 25 05:01:41.947764 dv-cinder-815582-6-iscsi devstack@keystone.service[85552]: [pid: 85552|app: 0|req: 1434/2903] 10.222.0.36 () {58 vars in 1232 bytes} [Thu Nov 25 05:01:41 2021] DELETE /identity/v3/projects/4b2fbc33d10047668d8743369cb2f442 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 25 05:02:30.662359 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Authenticating user token {{(pid=85551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 25 05:02:30.664260 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:02:30.761552 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bc8d-9293-4256-99ae-cd692426f0a5 admin admin] Validating token access rules against request {{(pid=85551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 25 05:02:30.820602 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '755f10706c5f44a79cc402f6accd1edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fdbf5d9919b49808ec8578b9e5f2956', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 25 05:02:30.821257 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] REQUEST_METHOD: `GET` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 25 05:02:30.821543 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] SCRIPT_NAME: `/identity` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 25 05:02:30.821803 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 25 05:02:30.823892 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.fernet_utils [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 25 05:02:30.835696 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 25 05:02:30.837311 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e17582-2970-4668-aa39-afa78d34e687 service placement] RBAC: Authorization granted {{(pid=85551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 25 05:02:30.847701 dv-cinder-815582-6-iscsi devstack@keystone.service[85551]: [pid: 85551|app: 0|req: 1470/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Nov 25 05:02:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)